-- Logs begin at Tue 2022-06-28 02:18:06 UTC, end at Tue 2022-06-28 03:38:03 UTC. -- Jun 28 03:09:23.525030 dv-cinder-846842-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 28 03:09:23.534983 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 28 03:09:23.537259 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 28 03:09:23 2022] *** Jun 28 03:09:23.537259 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 28 03:09:23.537259 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 28 03:09:23.537259 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: nodename: dv-cinder-846842-5-iscsi Jun 28 03:09:23.537259 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: machine: x86_64 Jun 28 03:09:23.537259 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: clock source: unix Jun 28 03:09:23.537259 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: pcre jit disabled Jun 28 03:09:23.537259 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: detected number of CPU cores: 4 Jun 28 03:09:23.537259 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: current working directory: / Jun 28 03:09:23.537259 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: detected binary path: /usr/bin/uwsgi-core Jun 28 03:09:23.537919 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: your processes number limit is 47680 Jun 28 03:09:23.537919 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: your memory page size is 4096 bytes Jun 28 03:09:23.537919 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: detected max file descriptor number: 2048 Jun 28 03:09:23.537919 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: lock engine: pthread robust mutexes Jun 28 03:09:23.537919 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: thunder lock: enabled Jun 28 03:09:23.537919 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 28 03:09:23.537919 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 28 03:09:23.580147 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: Python main interpreter initialized at 0x55d5877109c0 Jun 28 03:09:23.580147 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: python threads support enabled Jun 28 03:09:23.580147 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: your server socket listen backlog is limited to 100 connections Jun 28 03:09:23.580147 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: your mercy for graceful operations on workers is 90 seconds Jun 28 03:09:23.580545 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: mapped 403077 bytes (393 KB) for 2 cores Jun 28 03:09:23.580545 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: *** Operational MODE: preforking *** Jun 28 03:09:23.580831 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: *** uWSGI is running in multiple interpreter mode *** Jun 28 03:09:23.580831 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: spawned uWSGI master process (pid: 103152) Jun 28 03:09:23.581044 dv-cinder-846842-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 28 03:09:23.581579 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: spawned uWSGI worker 1 (pid: 103153, cores: 1) Jun 28 03:09:23.581910 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: spawned uWSGI worker 2 (pid: 103154, cores: 1) Jun 28 03:09:23.582065 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 28 03:09:24.225943 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 28 03:09:24.226588 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 28 03:09:25.326717 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 03:09:25.326717 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: from cryptography.utils import int_from_bytes Jun 28 03:09:25.327447 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 03:09:25.327447 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: from cryptography.utils import int_from_bytes Jun 28 03:09:25.328189 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 03:09:25.328189 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: from cryptography.utils import int_from_bytes Jun 28 03:09:25.328642 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 03:09:25.328642 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: from cryptography.utils import int_from_bytes Jun 28 03:09:27.752402 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 03:09:27.752875 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 03:09:27.753143 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 03:09:27.753532 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 03:09:27.753745 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 03:09:27.754245 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.754539 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.754834 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.755179 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.755467 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.755800 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.756111 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.756449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.756768 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.757009 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.757107 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 03:09:27.757474 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 03:09:27.757554 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.757632 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-5-iscsi {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.757782 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 03:09:27.757882 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.758162 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 03:09:27.758296 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.758393 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 03:09:27.758465 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.758786 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.758920 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.759084 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.759237 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.759410 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.759510 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.759670 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.759778 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.760038 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.760211 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.760375 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.761434 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.761547 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.761622 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.761705 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.761774 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.761847 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.761920 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.761992 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.762064 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.762144 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.762211 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.762274 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-5-iscsi {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.762401 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.762553 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.762702 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.762832 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.763020 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.763140 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.763320 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.763412 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.763615 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.763717 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-5-iscsi {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.763938 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.764036 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.764261 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.764353 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.764610 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.764739 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.764995 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.765099 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.765298 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.765386 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.765597 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.765705 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.765907 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.766012 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.766220 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.766308 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.766517 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.766632 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.766834 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.766934 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.767140 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.767245 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.767446 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.767582 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.767747 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.767874 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.768041 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.768201 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-5-iscsi {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.768362 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.768489 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.768665 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.768854 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.768981 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.769123 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.769250 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.769447 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.769585 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.769773 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.770341 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.770341 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.770610 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.770610 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.770842 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.770963 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.771093 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.771231 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.771358 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.771484 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.771607 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.771607 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.771869 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.772000 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.772134 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.772367 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.772494 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.772630 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.772753 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.772874 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.773002 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.773126 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.773247 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.773382 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.773507 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.773655 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.773796 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.773957 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.774087 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.774224 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.774348 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.774505 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.774636 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.774821 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.774967 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.775131 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.775259 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.775445 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.775575 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.775704 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.775915 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.776040 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.776184 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.776320 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.776449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.776582 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.776715 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.776849 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.776974 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.777164 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.777344 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.777497 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.777629 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.777752 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.777882 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.778009 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.778179 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.778323 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.778521 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.778715 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.778851 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.778986 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.779110 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.779243 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.779367 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.779489 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.779654 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.779788 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.780003 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.780232 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.780371 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.780505 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.780654 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.780783 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.780914 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.781046 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.781183 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.781305 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.781427 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.781643 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.781839 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.781975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.782101 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.782223 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.782346 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.782519 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.782660 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.782811 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.782941 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.783141 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.783320 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.783453 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.783597 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.783725 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.783855 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.783981 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.784109 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.784272 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.784407 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.784609 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.784805 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.785023 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.785156 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.785357 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.786429 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.786570 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.786696 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.786818 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.786947 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.787089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.787212 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.787343 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.787466 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.787587 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.787708 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.787844 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.787976 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.788100 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.788288 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.788411 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.788545 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.788687 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.788818 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.788938 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.789069 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.789201 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.789322 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.789452 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.789574 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.789694 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.789815 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.789943 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.790078 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.790280 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.790404 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.790526 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.790647 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.790778 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.790915 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.791037 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.791158 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.791286 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.791408 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.791528 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.791659 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.791791 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.791914 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.792043 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.792185 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.792322 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.792455 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.792579 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.792700 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.792821 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.792950 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.793072 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.793203 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.793326 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.793447 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.793576 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.793699 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.793829 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.793960 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.794082 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.794215 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.794338 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.794460 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.794591 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.794715 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.794836 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.794964 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.795171 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.795351 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.795500 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.795632 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.795765 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.795897 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.796023 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.796145 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.796351 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.796486 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.796616 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.796748 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.796946 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.797137 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.797284 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.797420 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.797554 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.797678 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.797800 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.797932 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.798058 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.798256 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.798435 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.798559 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.798692 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.798830 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.798956 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.799109 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.799247 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.799422 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.799549 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:09:27.799734 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.799862 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.800057 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.800211 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.800392 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.800519 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.800702 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.800839 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.801071 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.801565 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.801695 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.801695 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.802016 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.802138 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.802266 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.802411 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.802542 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.802664 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.802802 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.802925 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.803054 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.803177 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.803298 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.803428 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.803551 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.803742 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.803871 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.804060 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.804208 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.804390 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.804526 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.804695 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.804820 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.805000 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.805129 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.805316 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.805443 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.805629 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.805755 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.805930 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.806060 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.806240 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.806367 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.806546 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.806673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.806851 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.806988 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.807155 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.807289 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.807459 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.807586 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.807762 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.807899 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.808091 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.808271 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.808425 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.808559 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.808737 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.808876 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.809043 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.809171 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.809355 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.809488 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.809659 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.809792 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.809962 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.810096 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.810266 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.810393 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.810562 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.810690 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.810861 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.810987 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.811157 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.811285 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.811459 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.811593 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.811755 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.811888 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.812060 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.812209 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.812392 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.812528 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.812688 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.812812 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.813030 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.813193 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.813329 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.813462 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.813592 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.813714 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.813900 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.814035 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.814205 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.814333 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.814501 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.814633 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.814844 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.814982 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.815112 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.815232 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.815390 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.815517 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.815689 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.815823 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.815997 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.816132 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.816308 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.816430 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.816990 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.817153 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.817280 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.817403 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.817527 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.817649 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.817771 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.817902 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.818026 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.818148 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.818280 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.818404 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.818536 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.818711 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.818838 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.819020 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.819155 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.819323 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.819459 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.819627 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.819751 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.819932 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.820063 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.820261 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.820411 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.820577 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.820703 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.820897 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.821036 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.821200 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.821338 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.821511 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.821637 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.821808 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.821944 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.822105 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.822231 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.822401 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.822525 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.822697 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.822824 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.822996 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.823123 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.823300 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.823434 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.823597 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.823720 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.823921 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.824057 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.824235 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.824362 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.824485 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.824620 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.824766 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.824892 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.825079 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.825213 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.825382 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.825519 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.825680 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.825807 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.825980 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.826113 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.826275 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.826415 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.826609 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.826735 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.826907 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.827041 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.827235 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.827372 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.827540 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.827673 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.827841 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.827978 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.828146 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.828305 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.828459 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.828618 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.828747 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.828866 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.829045 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.829173 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.829346 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.829472 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.829645 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.829771 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.829949 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.830089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.830255 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.830380 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.830554 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.830679 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.830854 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.830980 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.831155 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.831281 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.831467 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.831591 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.831769 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.831899 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.832082 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.832391 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.832617 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.833059 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.833189 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.833320 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.833444 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.833573 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.833705 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.833844 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.833968 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.834098 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.834222 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.834352 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.834475 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.834611 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.834742 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.834873 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.834996 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.835118 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.835239 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.835372 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.835502 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.835626 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.835749 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.835932 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.836068 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.836269 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.836391 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.836577 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.836713 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.836889 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.837030 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.837191 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.837317 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.837508 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.837634 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.837810 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.837946 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.838120 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.838246 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.838415 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.838551 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.838722 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.838858 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.839042 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.839167 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.839351 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.839492 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.839651 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.839789 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.839954 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.840081 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.840280 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.840408 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.840624 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.840752 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.840890 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.841094 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.841220 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.841341 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.841472 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.841597 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.841727 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.841851 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.842022 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.842156 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.842320 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.842445 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.842617 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.842745 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.842919 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.843045 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.843218 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.843344 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.843529 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.843657 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.843830 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.843965 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.844128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.844273 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.844444 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.844569 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.844748 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.844887 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.845060 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.845186 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.845362 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.845494 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.845667 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.845802 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.845971 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.846096 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.846264 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.846388 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.846561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.846695 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.846869 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.846994 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.847168 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.847292 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.847464 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.847592 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.847819 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.848379 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.848512 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.848636 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.848768 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.848892 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.849016 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.849138 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.849260 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.849382 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.849518 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.849643 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.849777 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.849908 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.850033 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.850165 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.850297 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.850431 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.850554 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.850676 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.850852 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.850992 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.851152 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.851279 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.851471 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.851596 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.851771 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.851974 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.852114 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.852262 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.852397 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.852524 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.852668 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.852808 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.852969 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.853095 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.853284 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.853418 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.853586 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.853725 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.853890 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.854017 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.854193 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.854320 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.854494 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.854620 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.854799 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.854925 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.855102 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.855229 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.855409 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.855673 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.855799 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.856006 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.856132 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.856338 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.856483 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.856649 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.856775 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.856956 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.857082 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.857265 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.857402 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.857573 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.857700 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.857892 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.858019 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.858199 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.858327 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.858506 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.858643 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.858811 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.858943 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.859111 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.859234 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.859405 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.859539 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.859712 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.859838 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.860013 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.860301 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.860433 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.860618 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.860745 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.860920 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.861058 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.861559 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.861689 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.861856 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.861982 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.862151 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.862290 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.862430 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.862562 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.862742 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.862878 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.863039 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.863164 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.863371 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.863697 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.864287 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.864421 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.864544 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.864668 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.864792 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.864929 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.865055 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.865177 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.865309 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.865432 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.865558 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.865694 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.865818 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.865939 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.866060 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.866181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.866312 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.866436 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.866557 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.866670 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.866791 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.866922 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.867060 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.867183 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.867305 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.867434 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.867600 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.867726 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.867896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.868032 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.868214 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.868343 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.868514 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.868653 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.868818 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.868954 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.869118 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.869244 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.869412 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.869551 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.869714 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.869840 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.870015 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.870141 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.870315 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.870454 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.870616 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.870749 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.870911 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.871038 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.871212 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.871347 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.871507 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.871628 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.871816 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.871953 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.872117 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.872311 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.872447 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.872578 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.872715 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.872838 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.873008 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.873136 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.873311 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.873436 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.873607 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.873745 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.873909 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.874044 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.874205 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.874339 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.874506 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.874630 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.874797 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.874922 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.875091 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.875217 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.875383 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.875586 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.875721 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.875835 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.875956 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.876080 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.876272 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.876413 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.876582 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.876707 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.876881 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.877015 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.877177 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.877311 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.877475 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.877601 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.877775 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.877906 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.878067 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.878201 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.878361 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.878486 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.878656 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.878781 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.878964 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.879116 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.879651 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.879795 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.879920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.880043 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.880210 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.880338 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.880463 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.880585 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.880709 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.880831 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.880967 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.881091 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.881220 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.881343 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.881473 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.881596 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.881727 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.881850 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.881979 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.882102 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.882224 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.882355 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.882523 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.882649 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.882823 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.882999 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.883122 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.883251 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.883409 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.883536 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.883710 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.883835 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.884004 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.884140 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.884334 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.884459 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.884640 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.884768 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.884942 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.885078 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.885243 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.885378 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.885550 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.885677 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.885849 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.885978 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.886148 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.886273 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.886446 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.886574 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.886748 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.886933 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.887070 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.887196 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.887318 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.887439 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.887624 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.887753 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.887929 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.888053 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.888236 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.888361 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.888529 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.888657 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.888844 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.888970 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.889150 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.889290 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.889451 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.889576 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.889763 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.889890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.890077 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.890212 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.890382 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.890514 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.890674 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.890799 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.890976 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.891120 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.891279 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.891404 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.891578 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.891701 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.891876 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.892014 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.892196 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.892325 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.892501 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.892639 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.892799 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.892933 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.893102 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.893227 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.893408 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.893533 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.893711 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.893836 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.894008 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.894134 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.894312 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.894451 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.894649 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.894898 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.895353 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.895480 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.895610 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.895733 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.895865 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.895994 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.896118 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.896291 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.896414 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.896549 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.896687 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.896812 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.896934 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.897055 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.897178 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.897308 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.897308 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.897547 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.897671 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.897791 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.897912 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.898051 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.898201 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.898328 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.898505 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.898640 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.898812 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.898949 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.899118 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.899247 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.899425 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.899551 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.899723 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.899856 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.900040 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.900188 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.900367 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.900493 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.900675 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.900811 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.900980 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.901107 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.901287 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.901414 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.901588 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.901727 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.901888 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.902005 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.902203 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.902329 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.902502 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.902629 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.902800 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.902926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.903097 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.903222 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.903427 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.903566 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.903698 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.903821 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.903995 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.904131 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.904392 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.904518 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.904715 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.904839 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.905014 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.905152 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.905396 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.905529 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.905703 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.905829 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.906003 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.906130 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.906301 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.906426 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.906607 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.906727 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.906921 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.907059 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.907218 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.907343 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.907519 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.907645 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.907818 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.907944 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.908128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.908283 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.908452 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.908576 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.908756 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.908882 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.909065 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.909199 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.909364 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.909497 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.909681 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.909820 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.910000 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.910134 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.910410 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.910947 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.911085 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.911209 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.911341 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.911466 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.911598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.911730 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.911862 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.911986 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.912118 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.912271 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.912395 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.912518 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.912640 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.912822 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.912952 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.913128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.913252 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.913426 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.913555 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.913755 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.913889 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.914014 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.914144 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.914310 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.914437 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.914613 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.914741 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.914917 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.915044 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.915218 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.915346 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.915516 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.915643 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.915813 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.915940 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.916127 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.916303 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.916431 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.916553 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.916748 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.916874 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.917054 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.917189 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.917369 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.917496 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.917683 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.917810 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.917979 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.918116 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.918292 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.918419 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.918593 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.918719 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.918891 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.919032 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.919188 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.919321 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.919484 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.919610 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.919810 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.919936 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.920105 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.920255 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.920433 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.920559 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.920737 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.920865 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.921057 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.921184 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.921359 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.921483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.921677 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.921810 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.921989 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.922115 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.922297 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.922423 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.922609 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.922736 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.922909 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.923034 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.923214 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.923349 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.923509 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.923635 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.923813 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.923946 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.924109 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.924285 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.924431 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.924525 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.924728 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.924816 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.925029 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.925146 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.925327 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.925422 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.925621 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.925719 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.926035 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.926132 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.926389 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.926591 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.926690 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.926938 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.927036 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.927270 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.927431 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.927598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.927747 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.927888 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.928037 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.928221 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.928369 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.928508 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.928647 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.928839 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.928990 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.929129 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.929276 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.929414 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.929563 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.929704 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.929851 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.929997 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.930135 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.930295 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.930439 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.930615 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.930759 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.930907 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.931045 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.931190 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.931328 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.931487 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.931626 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.931787 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.931931 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.932107 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.932316 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.932477 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.932626 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.932765 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.932904 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.933041 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.933178 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.933324 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.933474 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.933611 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.933756 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.933895 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.934049 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.934219 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.934436 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.934580 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.934764 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.934908 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.935056 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.935204 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.935379 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.935518 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.935658 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.935795 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.935942 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.936082 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.936271 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.936418 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.936562 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.936667 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.936904 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.937039 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.937180 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.937292 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.937515 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.937668 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.937810 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.937909 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.938150 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.938284 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.938470 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.938619 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.938793 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.938925 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.939101 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.939247 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.939415 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.939602 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.939715 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.939947 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.940082 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.940286 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.940448 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.940575 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.940669 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.940893 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.940989 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.941204 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.941319 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.941547 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.941646 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.941866 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.942059 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.942242 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.942404 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.942501 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.942653 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.942818 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.942967 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.943119 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.943273 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.943423 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.943565 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.943703 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.943851 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.944030 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.944210 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.944358 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.944497 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.944675 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.944832 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.944972 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.945120 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.945285 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.945441 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.945640 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.945803 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.945944 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.946082 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.946245 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.946389 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.946556 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.946751 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.946905 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.947062 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.947211 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.947373 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.947558 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.947707 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.947853 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.947991 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.948129 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.948306 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.948457 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.948599 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.948736 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.948921 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.949067 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.949228 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.949381 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.949520 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.949659 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.949804 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.949944 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.950112 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.950257 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.950397 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.950534 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.950708 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.950866 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.951015 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.951153 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.951291 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.951428 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.951595 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.951870 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.952025 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.952200 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.952433 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.952589 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.952781 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.952937 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.953086 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.953223 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.953395 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.953547 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.953715 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.953870 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.954010 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.954156 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.954302 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.954448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.954614 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.954767 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.954917 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.955062 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.955216 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.955364 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.955502 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.955655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.955794 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.955933 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.956071 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.956246 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.956399 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.956548 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.956695 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.956854 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.957002 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.957231 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.957435 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.957986 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.958134 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.958275 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.958415 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.958554 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.958702 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.958850 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.958997 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.959151 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.959290 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.959428 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.959582 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.959721 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.959859 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.960004 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.960197 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.960344 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.960495 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.960635 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.960773 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.960919 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.961067 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.961220 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.961367 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.961506 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.961652 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.961791 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.961929 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.962075 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.962214 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.962352 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.962489 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.962626 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.962773 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.962931 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.963070 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.963216 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.963355 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.963493 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.963631 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.963785 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.963923 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.964062 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.964215 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.964359 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.964513 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.964653 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.964800 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.964947 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.965084 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.965221 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.965374 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.965514 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.965653 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.965798 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.965937 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.966082 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.966238 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.966238 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.966511 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.966660 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.966808 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.966947 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.967094 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.967232 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.967370 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.967510 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.967648 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.967795 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.967942 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.968082 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.968245 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.968397 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.968537 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.968686 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.968833 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.968972 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.969110 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.969248 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.969386 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.969533 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.969672 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.969834 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.969988 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.970135 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.970285 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.970506 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.970649 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.970787 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.970926 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.971065 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.971212 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.971401 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.971586 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.971732 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.971918 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.972063 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.972285 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.972431 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.972570 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.972728 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.972961 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.973445 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.973598 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.973752 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.973900 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.974040 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.974188 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.974341 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.974489 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.974640 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.974780 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.974918 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.975055 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.975203 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.975342 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.975480 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.975618 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.975756 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.975894 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.976146 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.976328 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.976468 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.976622 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.976760 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.976923 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.977067 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.977218 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.977356 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.977493 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.977632 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.977784 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.977932 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.978070 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.978218 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.978374 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.978514 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.978660 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.978799 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.978938 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.979076 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.979214 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.979361 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.979509 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.979648 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.979786 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.979930 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.980096 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.980277 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.980418 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.980558 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.980696 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.980834 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.980972 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.981131 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.981269 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.981408 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.981546 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.981693 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.981832 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.981993 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.982133 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.982271 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.982409 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.982547 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.982694 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.982836 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.982990 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.983130 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.983268 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.983406 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.983557 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.983708 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.983847 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.983995 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.984133 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.984299 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.984450 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.984598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.984738 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.985061 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.985061 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.985378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.985518 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.985670 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.985819 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.985958 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.986096 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.986592 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.986740 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.986879 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.987017 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.987155 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.987293 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.987474 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.987621 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.987760 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.987970 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.988111 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.988322 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.988610 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.989136 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.989284 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.989424 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.989573 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.989727 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.989867 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.990059 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.990244 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.990396 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.990621 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.990777 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.990917 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.991056 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.991193 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.991331 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.991469 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.991622 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.991761 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.991899 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.992037 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.992198 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.992343 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.992430 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.992505 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.992584 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.992662 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.992740 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.992826 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.992908 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.992998 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.993087 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.993170 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.993255 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.993255 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.993410 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.993521 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.993610 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.993826 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.993914 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.994131 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.994219 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.994437 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.994532 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.994756 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.994852 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.995072 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.995159 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.995371 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.995457 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.995688 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.995784 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.995999 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.996123 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.996335 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.996477 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.996645 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.996812 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.996950 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.997162 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.997294 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.997494 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.997600 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.997829 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.997929 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.998140 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.998238 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.998443 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.998613 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.998746 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.998852 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.999056 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.999153 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.999366 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.999465 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.999683 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:27.999771 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.000000 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.000088 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.000347 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.000451 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.000667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.000762 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.000986 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.001074 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.001329 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.001419 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.001637 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.001724 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.001975 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.002064 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.002293 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.002382 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.002608 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.002694 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.002911 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.002997 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.003206 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.003295 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.003443 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 03:09:28.003556 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.003874 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.004625 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.004944 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.005273 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.005594 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.005922 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.006248 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.006582 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.006914 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.007250 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.007566 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.007899 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.008281 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.008611 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.008965 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.009300 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.009619 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.009936 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.010244 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:09:28.010491 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 03:09:28.063956 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO dbcounter [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] Registered counter for database nova_api Jun 28 03:09:28.072427 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO dbcounter [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] Registered counter for database nova_api Jun 28 03:09:28.180384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_db.sqlalchemy.engines [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:09:28.187077 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG oslo_db.sqlalchemy.engines [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:09:28.187261 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writer thread running {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:09:28.193633 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG dbcounter [-] [103153] Writer thread running {{(pid=103153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:09:28.242476 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.context [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e98e3abb-bf26-4fd3-abd9-1f639c67dc6f(cell1) {{(pid=103154) load_cells /opt/stack/nova/nova/context.py:464}} Jun 28 03:09:28.246348 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:09:28.247913 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:09:28.248716 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:09:28.249981 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.context [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e98e3abb-bf26-4fd3-abd9-1f639c67dc6f(cell1) {{(pid=103153) load_cells /opt/stack/nova/nova/context.py:464}} Jun 28 03:09:28.250772 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:09:28.252800 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO dbcounter [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] Registered counter for database nova_cell0 Jun 28 03:09:28.253924 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG oslo_concurrency.lockutils [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:09:28.255701 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG oslo_concurrency.lockutils [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:09:28.256523 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG oslo_concurrency.lockutils [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:09:28.256708 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO dbcounter [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] Registered counter for database nova_cell1 Jun 28 03:09:28.258647 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG oslo_concurrency.lockutils [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:09:28.260691 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO dbcounter [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] Registered counter for database nova_cell0 Jun 28 03:09:28.264301 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_db.sqlalchemy.engines [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:09:28.264652 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO dbcounter [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] Registered counter for database nova_cell1 Jun 28 03:09:28.265593 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_db.sqlalchemy.engines [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:09:28.272007 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG oslo_db.sqlalchemy.engines [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:09:28.272284 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writer thread running {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:09:28.274298 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writer thread running {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:09:28.275824 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG oslo_db.sqlalchemy.engines [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:09:28.277358 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG dbcounter [-] [103153] Writer thread running {{(pid=103153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:09:28.419866 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO dbcounter [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] Registered counter for database nova_cell0 Jun 28 03:09:28.421167 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG dbcounter [-] [103153] Writer thread running {{(pid=103153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:09:28.429777 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_db.sqlalchemy.engines [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:09:28.430807 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO dbcounter [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] Registered counter for database nova_cell0 Jun 28 03:09:28.434887 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writer thread running {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:09:28.439794 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG oslo_db.sqlalchemy.engines [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:09:28.445435 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG dbcounter [-] [103153] Writer thread running {{(pid=103153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:09:28.768860 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: WARNING keystonemiddleware.auth_token [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 03:09:28.769816 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: WARNING keystonemiddleware.auth_token [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 03:09:28.776427 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: WARNING keystonemiddleware.auth_token [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 03:09:28.777086 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: WARNING keystonemiddleware.auth_token [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 03:09:29.119839 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: WARNING keystonemiddleware.auth_token [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 03:09:29.120041 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: WARNING keystonemiddleware.auth_token [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 03:09:29.125877 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: WARNING keystonemiddleware.auth_token [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 03:09:29.126043 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: WARNING keystonemiddleware.auth_token [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 03:09:29.131096 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5877109c0 pid: 103153 (default app) Jun 28 03:09:29.131502 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5877109c0 pid: 103154 (default app) Jun 28 03:09:29.133193 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:09:29.134471 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-48a65f52-ccd8-41a7-943f-c83bc9e91d36 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001828 Jun 28 03:09:29.134867 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Tue Jun 28 03:09:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:10:44.179524 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:10:44.181017 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002351 Jun 28 03:10:44.181512 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:10:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:10:44.193697 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG dbcounter [-] [103153] Writing DB stats nova_api:SELECT=3 {{(pid=103153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:10:44.196509 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG dbcounter [-] [103153] Writing DB stats nova_cell0:SELECT=3 {{(pid=103153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:10:44.197464 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG dbcounter [-] [103153] Writing DB stats nova_cell1:SELECT=3 {{(pid=103153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:10:44.198308 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG dbcounter [-] [103153] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:10:44.621581 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-da8eec6a-f36a-43fc-8115-fee4f1274438 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:10:44.652330 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-da8eec6a-f36a-43fc-8115-fee4f1274438 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.464440 Jun 28 03:10:44.653279 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 2/3] 10.222.0.44 () {60 vars in 1291 bytes} [Tue Jun 28 03:10:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:10:46.705086 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:10:46.706084 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-bb263d7d-2c88-4b08-a964-d537e7d1b537 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jun 28 03:10:46.707642 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 2/4] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:10:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:10:46.767533 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-0bd1aa7c-cfe2-49fc-9bce-f863e0610d10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "cirros256", "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 256}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:10:46.786248 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:10:46.786248 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: warnings.warn(msg) Jun 28 03:10:46.814940 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-0bd1aa7c-cfe2-49fc-9bce-f863e0610d10 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102616 Jun 28 03:10:46.815588 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 3/5] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 28 03:10:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 28 03:10:46.829602 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_api:SELECT=3 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:10:46.830792 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_cell1:SELECT=3 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:10:46.831710 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_cell0:SELECT=3 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:10:46.832488 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:10:47.036967 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-5831150d-e820-421a-8b01-a4634e228610 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:10:47.039413 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:10:47.039413 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Jun 28 03:10:47.100940 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-5831150d-e820-421a-8b01-a4634e228610 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.276671 Jun 28 03:10:47.101666 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 3/6] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jun 28 03:10:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:10:49.168773 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-0bd1aa7c-cfe2-49fc-9bce-f863e0610d10 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:10:49.169829 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-0bd1aa7c-cfe2-49fc-9bce-f863e0610d10 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Jun 28 03:10:49.170387 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 4/7] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:10:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:10:49.277956 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-bb4f6d5d-3bf5-421d-80a2-27cd3dce54a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "ram": 512, "disk": 5}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:10:49.295728 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:10:49.295728 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Jun 28 03:10:49.317402 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-bb4f6d5d-3bf5-421d-80a2-27cd3dce54a6 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140519 Jun 28 03:10:49.317977 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 4/8] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 28 03:10:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:10:49.330025 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-32766d04-abe8-4b87-8f7a-4d137b1051a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:10:49.332260 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:10:49.332260 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: warnings.warn(msg) Jun 28 03:10:49.366483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-32766d04-abe8-4b87-8f7a-4d137b1051a2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040082 Jun 28 03:10:49.366985 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 5/9] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jun 28 03:10:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:10:51.462545 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-bb4f6d5d-3bf5-421d-80a2-27cd3dce54a6 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:10:51.463567 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-bb4f6d5d-3bf5-421d-80a2-27cd3dce54a6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 28 03:10:51.464289 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:10:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:10:51.525737 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-e9780263-d7bd-46a2-abac-e0d33e5f00b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:10:51.544558 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-e9780263-d7bd-46a2-abac-e0d33e5f00b6 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074544 Jun 28 03:10:51.545423 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 6/11] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 28 03:10:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:10:51.557284 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-6669f723-fc2d-4e33-94ff-7a4987065e3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:10:51.580830 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-6669f723-fc2d-4e33-94ff-7a4987065e3e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027259 Jun 28 03:10:51.581457 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 6/12] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jun 28 03:10:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:10:53.687383 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-e9780263-d7bd-46a2-abac-e0d33e5f00b6 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:10:53.688462 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-e9780263-d7bd-46a2-abac-e0d33e5f00b6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jun 28 03:10:53.688875 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 7/13] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:10:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:10:53.749565 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e9f7619f-d104-403e-9131-0f4c27940a10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:10:53.768596 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e9f7619f-d104-403e-9131-0f4c27940a10 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073667 Jun 28 03:10:53.769167 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 7/14] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 28 03:10:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:10:53.781248 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-e75dde37-1a34-4d79-86d7-1373f8233b0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:10:53.805331 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-e75dde37-1a34-4d79-86d7-1373f8233b0a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027957 Jun 28 03:10:53.805916 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 8/15] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jun 28 03:10:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:10:55.854727 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e9f7619f-d104-403e-9131-0f4c27940a10 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:10:55.855730 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e9f7619f-d104-403e-9131-0f4c27940a10 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jun 28 03:10:55.856087 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 8/16] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:10:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:10:55.929171 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-68a466de-c53b-42ba-aa57-8507bc90f877 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "id": "d4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:10:55.947621 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-68a466de-c53b-42ba-aa57-8507bc90f877 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085263 Jun 28 03:10:55.948221 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 9/17] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 28 03:10:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:10:55.961019 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-9b3d7cfc-e70f-4dc3-a085-f791f610e9ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:10:55.986675 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-9b3d7cfc-e70f-4dc3-a085-f791f610e9ae admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029444 Jun 28 03:10:55.987859 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 9/18] 10.222.0.44 () {64 vars in 1335 bytes} [Tue Jun 28 03:10:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:10:58.050838 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-68a466de-c53b-42ba-aa57-8507bc90f877 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:10:58.052609 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-68a466de-c53b-42ba-aa57-8507bc90f877 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Jun 28 03:10:58.053136 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 10/19] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:10:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:10:58.117320 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-b652e338-dddb-4f0c-ab98-a43b32a33af0 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:10:58.142622 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-b652e338-dddb-4f0c-ab98-a43b32a33af0 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083098 Jun 28 03:10:58.143445 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 10/20] 10.222.0.44 () {60 vars in 1291 bytes} [Tue Jun 28 03:10:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:11:00.216967 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-68a466de-c53b-42ba-aa57-8507bc90f877 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:00.217990 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-68a466de-c53b-42ba-aa57-8507bc90f877 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jun 28 03:11:00.218394 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 11/21] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:11:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:00.284313 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-da0e1bf8-b4e4-429b-9985-3e707f5131a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:00.307779 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-da0e1bf8-b4e4-429b-9985-3e707f5131a7 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.083255 Jun 28 03:11:00.308507 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 11/22] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 28 03:11:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:11:00.321077 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-b66685e1-b531-4d94-b509-37a3a21a3e88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:00.345586 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-b66685e1-b531-4d94-b509-37a3a21a3e88 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028389 Jun 28 03:11:00.346231 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 12/23] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jun 28 03:11:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:11:02.413428 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-da0e1bf8-b4e4-429b-9985-3e707f5131a7 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:02.414868 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-da0e1bf8-b4e4-429b-9985-3e707f5131a7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Jun 28 03:11:02.415392 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 12/24] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:11:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:02.477364 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-34692536-3a05-409c-b2ba-02cf6688dc3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:02.496483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-34692536-3a05-409c-b2ba-02cf6688dc3a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075158 Jun 28 03:11:02.497083 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 13/25] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 28 03:11:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:11:02.510643 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-1fdec240-8431-4108-8e8d-98e42693edb3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:02.538702 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-1fdec240-8431-4108-8e8d-98e42693edb3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032947 Jun 28 03:11:02.539286 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 13/26] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jun 28 03:11:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:11:04.612974 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-34692536-3a05-409c-b2ba-02cf6688dc3a admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:04.613986 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-34692536-3a05-409c-b2ba-02cf6688dc3a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001725 Jun 28 03:11:04.614429 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 14/27] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:11:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:04.677653 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-84aac288-fc42-4925-bd67-9806e565c17c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "swap": 0}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:04.697711 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-84aac288-fc42-4925-bd67-9806e565c17c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077433 Jun 28 03:11:04.698272 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 14/28] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 28 03:11:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:11:04.710326 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-26e8fa7f-f8c0-47d5-8532-28e99e80d1de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:04.733969 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-26e8fa7f-f8c0-47d5-8532-28e99e80d1de admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027344 Jun 28 03:11:04.734729 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 15/29] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jun 28 03:11:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:11:06.815954 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-84aac288-fc42-4925-bd67-9806e565c17c admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:06.816997 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-84aac288-fc42-4925-bd67-9806e565c17c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jun 28 03:11:06.817397 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 15/30] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:11:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:06.878327 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-48cb6eb4-f71b-40cd-90ed-cc1828cd31e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "disk": 80, "vcpus": 4, "id": "4", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:06.900143 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-48cb6eb4-f71b-40cd-90ed-cc1828cd31e0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076983 Jun 28 03:11:06.900704 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 16/31] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 28 03:11:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:11:06.912805 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-ab765ff4-b3c7-4658-9019-88b8708aef52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:06.936789 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-ab765ff4-b3c7-4658-9019-88b8708aef52 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027858 Jun 28 03:11:06.937411 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 16/32] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jun 28 03:11:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:11:09.001716 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-48cb6eb4-f71b-40cd-90ed-cc1828cd31e0 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:09.002711 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-48cb6eb4-f71b-40cd-90ed-cc1828cd31e0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 28 03:11:09.003109 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 17/33] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:09.062909 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-76d18ce3-48e3-4235-ae53-913a0a501d5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:09.092669 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-76d18ce3-48e3-4235-ae53-913a0a501d5d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.083388 Jun 28 03:11:09.093229 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 17/34] 10.222.0.44 () {64 vars in 1282 bytes} [Tue Jun 28 03:11:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 28 03:11:09.105889 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-f2d45d4a-b132-4091-974c-6f15badea42c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:09.133085 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-f2d45d4a-b132-4091-974c-6f15badea42c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031391 Jun 28 03:11:09.134028 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 18/35] 10.222.0.44 () {64 vars in 1332 bytes} [Tue Jun 28 03:11:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:11:33.425379 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-76d18ce3-48e3-4235-ae53-913a0a501d5d admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:33.426395 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-76d18ce3-48e3-4235-ae53-913a0a501d5d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 28 03:11:33.426792 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 18/36] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:11:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:33.441388 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG dbcounter [-] [103153] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:11:33.501032 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-c7f675c7-0418-44e4-a248-9983e11a272b admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:33.525457 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-c7f675c7-0418-44e4-a248-9983e11a272b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.092043 Jun 28 03:11:33.525999 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 19/37] 10.222.0.44 () {60 vars in 1291 bytes} [Tue Jun 28 03:11:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:11:34.449230 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-76d18ce3-48e3-4235-ae53-913a0a501d5d admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:34.450265 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-76d18ce3-48e3-4235-ae53-913a0a501d5d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 28 03:11:34.450659 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 19/38] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 28 03:11:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:34.654685 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-bf76dd7a-f5d1-4889-bda0-33537de1492e admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:34.662567 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.wsgi [None req-bf76dd7a-f5d1-4889-bda0-33537de1492e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-bf76dd7a-f5d1-4889-bda0-33537de1492e admin admin] Request method failure captured: Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Accept: application/json Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Accept-Encoding: gzip, deflate Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Connection: keep-alive Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Content-Length: 0 Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Host: 10.222.0.44 Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Openstack-Api-Version: compute 2.90 Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Openstack-System-Scope: None Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: User-Agent: python-novaclient Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Auth-Token: gAAAAABiunFmfZn8A_ovbachsuEB957ngEmMOEmlxCNdKG_327R4WLJkJ3XHriPSrMIiVhm0tXVtjozQlr-9-xF9kbZVkELKNY3CvRDW5cWCeiKVu1MtCA2IkFHyFyxJwaXkaiivSIqApuSYuP84HfEDtJGMiYXxPgCEqsY15EsvapakdGsG55E Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Domain-Id: None Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Domain-Name: None Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Identity-Status: Confirmed Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Is-Admin-Project: True Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Project-Domain-Id: default Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Project-Domain-Name: Default Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Project-Id: 05700e702dcf45e5a8f1eca6d3dc188c Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Project-Name: admin Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Role: admin,member,reader Jun 28 03:11:34.665926 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Roles: admin,member,reader Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_05700e702dcf45e5a8f1eca6d3dc188c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Tenant: admin Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Tenant-Id: 05700e702dcf45e5a8f1eca6d3dc188c Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Tenant-Name: admin Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User: admin Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User-Domain-Id: default Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User-Domain-Name: Default Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User-Id: 27fddc14e0024a149a09fed16d6ba1f9 Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User-Name: admin Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: method: > Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: exception: Flavor 42 could not be found. Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: action_args: {'id': '42'} Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:11:34.667655 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:11:34.669181 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:34.670483 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-bf76dd7a-f5d1-4889-bda0-33537de1492e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:11:34.672999 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-bf76dd7a-f5d1-4889-bda0-33537de1492e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.078781 Jun 28 03:11:34.672999 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 20/39] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Jun 28 03:11:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:34.679267 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-5c92da12-171a-4f9a-8718-e0c10401e3d5 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:34.683713 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:11:34.705065 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-5c92da12-171a-4f9a-8718-e0c10401e3d5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030967 Jun 28 03:11:34.705609 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 20/40] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jun 28 03:11:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:11:34.715785 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-0eb77c6b-22b1-4917-b629-d849c875d666 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:34.738164 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-0eb77c6b-22b1-4917-b629-d849c875d666 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026067 Jun 28 03:11:34.738711 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 21/41] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jun 28 03:11:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:11:34.748607 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-24ddbc32-1dab-4231-8ff3-04c654cd8dc6 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:34.754873 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.wsgi [None req-24ddbc32-1dab-4231-8ff3-04c654cd8dc6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-24ddbc32-1dab-4231-8ff3-04c654cd8dc6 admin admin] Request method failure captured: Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Accept: application/json Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Accept-Encoding: gzip, deflate Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Connection: keep-alive Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Content-Length: 0 Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Host: 10.222.0.44 Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Openstack-Api-Version: compute 2.90 Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Openstack-System-Scope: None Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: User-Agent: python-novaclient Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Auth-Token: gAAAAABiunFmfZn8A_ovbachsuEB957ngEmMOEmlxCNdKG_327R4WLJkJ3XHriPSrMIiVhm0tXVtjozQlr-9-xF9kbZVkELKNY3CvRDW5cWCeiKVu1MtCA2IkFHyFyxJwaXkaiivSIqApuSYuP84HfEDtJGMiYXxPgCEqsY15EsvapakdGsG55E Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Domain-Id: None Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Domain-Name: None Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Identity-Status: Confirmed Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Is-Admin-Project: True Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Project-Domain-Id: default Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Project-Domain-Name: Default Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Project-Id: 05700e702dcf45e5a8f1eca6d3dc188c Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Project-Name: admin Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Role: admin,member,reader Jun 28 03:11:34.758182 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Roles: admin,member,reader Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_05700e702dcf45e5a8f1eca6d3dc188c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Tenant: admin Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Tenant-Id: 05700e702dcf45e5a8f1eca6d3dc188c Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Tenant-Name: admin Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User: admin Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User-Domain-Id: default Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User-Domain-Name: Default Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User-Id: 27fddc14e0024a149a09fed16d6ba1f9 Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User-Name: admin Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: method: > Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: exception: Flavor 42 could not be found. Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: action_args: {'id': '42'} Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:11:34.759561 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:11:34.760449 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:34.761535 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-24ddbc32-1dab-4231-8ff3-04c654cd8dc6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:11:34.762491 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-24ddbc32-1dab-4231-8ff3-04c654cd8dc6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014612 Jun 28 03:11:34.762491 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 21/42] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Jun 28 03:11:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 28 03:11:35.587232 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-0eb77c6b-22b1-4917-b629-d849c875d666 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:35.588279 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-0eb77c6b-22b1-4917-b629-d849c875d666 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 28 03:11:35.588671 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 22/43] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 28 03:11:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:35.793696 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-018cfa3f-ba1f-415e-b0d4-4e99eb3a07fb admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:35.799640 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.wsgi [None req-018cfa3f-ba1f-415e-b0d4-4e99eb3a07fb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-018cfa3f-ba1f-415e-b0d4-4e99eb3a07fb admin admin] Request method failure captured: Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Accept: application/json Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Accept-Encoding: gzip, deflate Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Connection: keep-alive Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Content-Length: 0 Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Host: 10.222.0.44 Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Openstack-Api-Version: compute 2.90 Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Openstack-System-Scope: None Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: User-Agent: python-novaclient Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Auth-Token: gAAAAABiunFnWrwI0JBEK8gMhgqjQrQWCZAVxkGR-sb1CJHdDybS4_8Zsx5aFFuJach6obuLp-XzyC4EN5SbF3a2gwmCnz5rIPkh8vr6RMFBGiDbdk2ON0EOpeTpCQcwsC0RCfheGV6qa-dcLhyKlyDnaRHK2RDaNQLkGdPQ9046oynw-Jla7g0 Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Domain-Id: None Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Domain-Name: None Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Identity-Status: Confirmed Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Is-Admin-Project: True Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Project-Domain-Id: default Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Project-Domain-Name: Default Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Project-Id: 05700e702dcf45e5a8f1eca6d3dc188c Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Project-Name: admin Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Role: admin,member,reader Jun 28 03:11:35.801598 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Roles: admin,member,reader Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_05700e702dcf45e5a8f1eca6d3dc188c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Tenant: admin Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Tenant-Id: 05700e702dcf45e5a8f1eca6d3dc188c Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Tenant-Name: admin Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User: admin Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User-Domain-Id: default Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User-Domain-Name: Default Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User-Id: 27fddc14e0024a149a09fed16d6ba1f9 Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User-Name: admin Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: method: > Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: exception: Flavor 84 could not be found. Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: action_args: {'id': '84'} Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:11:35.802896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:11:35.803667 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:35.804724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-018cfa3f-ba1f-415e-b0d4-4e99eb3a07fb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:11:35.806883 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-018cfa3f-ba1f-415e-b0d4-4e99eb3a07fb admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.069676 Jun 28 03:11:35.806883 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 22/44] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Jun 28 03:11:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:35.812827 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-dede7a6f-3789-4423-9c7e-8e6a91a13465 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:35.827533 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-dede7a6f-3789-4423-9c7e-8e6a91a13465 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018380 Jun 28 03:11:35.828064 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 23/45] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jun 28 03:11:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:11:35.837663 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-68ebe17d-28e3-44c5-a368-fa711c2bbadb admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:35.851368 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-68ebe17d-28e3-44c5-a368-fa711c2bbadb admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017234 Jun 28 03:11:35.851886 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 23/46] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jun 28 03:11:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:11:35.861475 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-20fb607d-5353-4aa0-b99d-f78a1fdf03d8 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:35.867195 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.wsgi [None req-20fb607d-5353-4aa0-b99d-f78a1fdf03d8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-20fb607d-5353-4aa0-b99d-f78a1fdf03d8 admin admin] Request method failure captured: Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Accept: application/json Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Accept-Encoding: gzip, deflate Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Connection: keep-alive Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Content-Length: 0 Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Host: 10.222.0.44 Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Openstack-Api-Version: compute 2.90 Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Openstack-System-Scope: None Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: User-Agent: python-novaclient Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Auth-Token: gAAAAABiunFnWrwI0JBEK8gMhgqjQrQWCZAVxkGR-sb1CJHdDybS4_8Zsx5aFFuJach6obuLp-XzyC4EN5SbF3a2gwmCnz5rIPkh8vr6RMFBGiDbdk2ON0EOpeTpCQcwsC0RCfheGV6qa-dcLhyKlyDnaRHK2RDaNQLkGdPQ9046oynw-Jla7g0 Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Domain-Id: None Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Domain-Name: None Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Identity-Status: Confirmed Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Is-Admin-Project: True Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Project-Domain-Id: default Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Project-Domain-Name: Default Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Project-Id: 05700e702dcf45e5a8f1eca6d3dc188c Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Project-Name: admin Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Role: admin,member,reader Jun 28 03:11:35.868731 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Roles: admin,member,reader Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_05700e702dcf45e5a8f1eca6d3dc188c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Tenant: admin Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Tenant-Id: 05700e702dcf45e5a8f1eca6d3dc188c Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Tenant-Name: admin Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User: admin Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User-Domain-Id: default Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User-Domain-Name: Default Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User-Id: 27fddc14e0024a149a09fed16d6ba1f9 Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User-Name: admin Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: method: > Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: exception: Flavor 84 could not be found. Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: action_args: {'id': '84'} Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:11:35.870089 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:11:35.870890 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:35.871920 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-20fb607d-5353-4aa0-b99d-f78a1fdf03d8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:11:35.872955 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-20fb607d-5353-4aa0-b99d-f78a1fdf03d8 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012591 Jun 28 03:11:35.872955 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 24/47] 10.222.0.44 () {60 vars in 1190 bytes} [Tue Jun 28 03:11:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:36.703436 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-68ebe17d-28e3-44c5-a368-fa711c2bbadb admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:36.704480 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-68ebe17d-28e3-44c5-a368-fa711c2bbadb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 28 03:11:36.704873 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 24/48] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 28 03:11:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:36.901422 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-3782e71d-16a2-44a1-b389-790bebc9af65 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:36.908318 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.wsgi [None req-3782e71d-16a2-44a1-b389-790bebc9af65 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-3782e71d-16a2-44a1-b389-790bebc9af65 admin admin] Request method failure captured: Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Accept: application/json Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Accept-Encoding: gzip, deflate Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Connection: keep-alive Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Content-Length: 0 Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Host: 10.222.0.44 Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Openstack-Api-Version: compute 2.90 Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Openstack-System-Scope: None Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: User-Agent: python-novaclient Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Auth-Token: gAAAAABiunFoN9UgmaKCWO3y3J8WZC50ZK-PgN5N2BPF8N4m8TN82DX9-xfQyxggNMys7WR9ulrpVGsObqaDQW3FFAJMIlfdNLPH1pjIzJDCHB4ji1CrIUkTf8vDgLSOfj5SQFFQymuOoEkscD95cm5NeywnX1shrJm9HyJeFBo_3LV--uoxo0w Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Domain-Id: None Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Domain-Name: None Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Identity-Status: Confirmed Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Is-Admin-Project: True Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Project-Domain-Id: default Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Project-Domain-Name: Default Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Project-Id: 05700e702dcf45e5a8f1eca6d3dc188c Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Project-Name: admin Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Role: admin,member,reader Jun 28 03:11:36.909975 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Roles: admin,member,reader Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_05700e702dcf45e5a8f1eca6d3dc188c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Tenant: admin Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Tenant-Id: 05700e702dcf45e5a8f1eca6d3dc188c Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-Tenant-Name: admin Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User: admin Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User-Domain-Id: default Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User-Domain-Name: Default Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User-Id: 27fddc14e0024a149a09fed16d6ba1f9 Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: X-User-Name: admin Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: method: > Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: exception: Flavor 451 could not be found. Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: action_args: {'id': '451'} Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:11:36.911448 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:11:36.912378 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: ERROR nova.api.openstack.wsgi Jun 28 03:11:36.913673 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-3782e71d-16a2-44a1-b389-790bebc9af65 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:11:36.914896 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-3782e71d-16a2-44a1-b389-790bebc9af65 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.069612 Jun 28 03:11:36.914896 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 25/49] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jun 28 03:11:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:36.920953 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-de05824c-28a1-4104-a1a4-fe49afe05787 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:36.934746 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-de05824c-28a1-4104-a1a4-fe49afe05787 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017397 Jun 28 03:11:36.935267 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 25/50] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jun 28 03:11:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:11:36.944937 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:36.959923 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018883 Jun 28 03:11:36.960473 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 26/51] 10.222.0.44 () {60 vars in 1210 bytes} [Tue Jun 28 03:11:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:11:36.973118 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-03ab37c6-0bb3-41c6-b207-d550bb6813b0 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:36.978577 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.wsgi [None req-03ab37c6-0bb3-41c6-b207-d550bb6813b0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-03ab37c6-0bb3-41c6-b207-d550bb6813b0 admin admin] Request method failure captured: Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Accept: application/json Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Accept-Encoding: gzip, deflate Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Connection: keep-alive Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Content-Length: 0 Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Host: 10.222.0.44 Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Openstack-Api-Version: compute 2.90 Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Openstack-System-Scope: None Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: User-Agent: python-novaclient Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Auth-Token: gAAAAABiunFoN9UgmaKCWO3y3J8WZC50ZK-PgN5N2BPF8N4m8TN82DX9-xfQyxggNMys7WR9ulrpVGsObqaDQW3FFAJMIlfdNLPH1pjIzJDCHB4ji1CrIUkTf8vDgLSOfj5SQFFQymuOoEkscD95cm5NeywnX1shrJm9HyJeFBo_3LV--uoxo0w Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Domain-Id: None Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Domain-Name: None Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Identity-Status: Confirmed Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Is-Admin-Project: True Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Openstack-Nova-Api-Version: 2.90 Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Project-Domain-Id: default Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Project-Domain-Name: Default Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Project-Id: 05700e702dcf45e5a8f1eca6d3dc188c Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Project-Name: admin Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Role: admin,member,reader Jun 28 03:11:36.980113 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Roles: admin,member,reader Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_05700e702dcf45e5a8f1eca6d3dc188c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05700e702dcf45e5a8f1eca6d3dc188c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Tenant: admin Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Tenant-Id: 05700e702dcf45e5a8f1eca6d3dc188c Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-Tenant-Name: admin Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User: admin Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User-Domain-Id: default Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User-Domain-Name: Default Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User-Id: 27fddc14e0024a149a09fed16d6ba1f9 Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: X-User-Name: admin Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: method: > Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: exception: Flavor 451 could not be found. Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: action_args: {'id': '451'} Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:11:36.981724 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:11:36.983128 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jun 28 03:11:36.984384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-03ab37c6-0bb3-41c6-b207-d550bb6813b0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:11:36.985590 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-03ab37c6-0bb3-41c6-b207-d550bb6813b0 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.014929 Jun 28 03:11:36.985590 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 26/52] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jun 28 03:11:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 28 03:11:37.810776 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:37.811775 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 28 03:11:37.812174 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 27/53] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 28 03:11:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:38.017305 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-d31ab274-8ce1-402a-a652-e9c8937c5974 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:38.038935 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-d31ab274-8ce1-402a-a652-e9c8937c5974 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.090563 Jun 28 03:11:38.039473 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 27/54] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Jun 28 03:11:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:11:38.882960 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:38.883959 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 28 03:11:38.884374 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 28/55] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 28 03:11:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:39.079264 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-961b00b5-0137-44d0-bbec-0bced37c38bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:39.100879 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-961b00b5-0137-44d0-bbec-0bced37c38bb admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.078864 Jun 28 03:11:39.101424 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 28/56] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Jun 28 03:11:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:11:39.913625 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:39.914625 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 28 03:11:39.915024 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 29/57] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 28 03:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:40.127883 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-46710817-481b-415e-9082-d7491a4394e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:40.148532 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-46710817-481b-415e-9082-d7491a4394e8 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.091804 Jun 28 03:11:40.149067 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 29/58] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Jun 28 03:11:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:11:40.978863 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:40.979866 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 28 03:11:40.980284 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 30/59] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 28 03:11:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:41.184331 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-0a670ad9-c67a-4977-8a9d-20ad19d4a83b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:11:41.205124 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-0a670ad9-c67a-4977-8a9d-20ad19d4a83b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.087864 Jun 28 03:11:41.205653 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 30/60] 10.222.0.44 () {64 vars in 1235 bytes} [Tue Jun 28 03:11:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:11:42.064308 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:42.065310 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 28 03:11:42.065707 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 31/61] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 28 03:11:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:11:42.257504 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-480f4340-6a58-4615-8a51-f2cde7b5454d admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:11:42.276502 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-480f4340-6a58-4615-8a51-f2cde7b5454d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074059 Jun 28 03:11:42.276983 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 31/62] 10.222.0.44 () {60 vars in 1202 bytes} [Tue Jun 28 03:11:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:12:29.214176 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:12:29.215929 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-95c552db-222c-44d2-9c4b-f4f60317c2d8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002378 Jun 28 03:12:29.216626 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 32/63] 10.222.0.44 () {54 vars in 930 bytes} [Tue Jun 28 03:12:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:12:29.230500 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:12:29.283831 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-ec0bc9eb-4fa9-45ff-af1b-2f91c9e59060 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:12:29.309969 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-ec0bc9eb-4fa9-45ff-af1b-2f91c9e59060 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.086944 Jun 28 03:12:29.310512 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 32/64] 10.222.0.44 () {60 vars in 1291 bytes} [Tue Jun 28 03:12:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:12:29.333739 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-ec0a3af0-21ff-4903-89f6-3485f31561a4 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:12:29.337426 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG dbcounter [-] [103153] Writing DB stats nova_api:SELECT=14 {{(pid=103153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:12:29.343451 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-ec0a3af0-21ff-4903-89f6-3485f31561a4 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013425 Jun 28 03:12:29.343971 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 33/65] 10.222.0.44 () {60 vars in 1282 bytes} [Tue Jun 28 03:12:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:12:29.358851 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e01b4991-1343-4bc0-8500-4135b0d888ed admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:12:29.369455 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e01b4991-1343-4bc0-8500-4135b0d888ed admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016680 Jun 28 03:12:29.369967 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 33/66] 10.222.0.44 () {60 vars in 1285 bytes} [Tue Jun 28 03:12:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:12:29.381852 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-d9cc650b-6dc6-44b0-8112-fd4b4c627e2f admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:12:29.389615 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-d9cc650b-6dc6-44b0-8112-fd4b4c627e2f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011695 Jun 28 03:12:29.390122 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 34/67] 10.222.0.44 () {60 vars in 1285 bytes} [Tue Jun 28 03:12:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:12:29.401440 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-f68c343e-0047-475e-b019-0607214a72b9 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:12:29.409133 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-f68c343e-0047-475e-b019-0607214a72b9 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011265 Jun 28 03:12:29.409640 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 34/68] 10.222.0.44 () {60 vars in 1282 bytes} [Tue Jun 28 03:12:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:15:44.523092 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-d9cc650b-6dc6-44b0-8112-fd4b4c627e2f admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:15:44.524097 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-d9cc650b-6dc6-44b0-8112-fd4b4c627e2f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 28 03:15:44.524518 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 35/69] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 28 03:15:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:15:44.665418 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_api:SELECT=6 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:15:44.792898 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-b6e9bf27-cdcb-4652-b7a0-df3fd4c4c930 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:15:44.794082 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:15:44.794082 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Jun 28 03:15:44.795274 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-b6e9bf27-cdcb-4652-b7a0-df3fd4c4c930 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:15:44.795701 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-b6e9bf27-cdcb-4652-b7a0-df3fd4c4c930 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:15:44.796529 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-b6e9bf27-cdcb-4652-b7a0-df3fd4c4c930 admin admin] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:15:44.796939 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-b6e9bf27-cdcb-4652-b7a0-df3fd4c4c930 admin admin] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:15:44.830731 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-b6e9bf27-cdcb-4652-b7a0-df3fd4c4c930 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.166865 Jun 28 03:15:44.831287 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 35/70] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jun 28 03:15:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:15:45.668325 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-d9cc650b-6dc6-44b0-8112-fd4b4c627e2f admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:15:45.669332 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-d9cc650b-6dc6-44b0-8112-fd4b4c627e2f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jun 28 03:15:45.669723 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 36/71] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 28 03:15:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:15:45.863555 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-5314eb61-8575-4c35-8bb8-d56928c8f8b4 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:15:45.864777 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:15:45.864777 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Jun 28 03:15:45.865960 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-5314eb61-8575-4c35-8bb8-d56928c8f8b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:15:45.866384 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-5314eb61-8575-4c35-8bb8-d56928c8f8b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:15:45.867154 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-5314eb61-8575-4c35-8bb8-d56928c8f8b4 admin admin] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:15:45.867573 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-5314eb61-8575-4c35-8bb8-d56928c8f8b4 admin admin] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:15:45.887102 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-5314eb61-8575-4c35-8bb8-d56928c8f8b4 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077255 Jun 28 03:15:45.887656 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 36/72] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jun 28 03:15:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:15:57.145329 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-d9cc650b-6dc6-44b0-8112-fd4b4c627e2f admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:15:57.146329 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-d9cc650b-6dc6-44b0-8112-fd4b4c627e2f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jun 28 03:15:57.146721 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 37/73] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 28 03:15:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:15:57.290138 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_cell0:SELECT=4 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:15:57.290861 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_cell1:SELECT=4 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:15:57.291468 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_api:SELECT=8 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:15:57.343911 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-07718766-b028-4d26-b4f5-d27bb4c7c873 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:15:57.345112 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:15:57.345112 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Jun 28 03:15:57.346295 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-07718766-b028-4d26-b4f5-d27bb4c7c873 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:15:57.346725 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-07718766-b028-4d26-b4f5-d27bb4c7c873 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:15:57.347494 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-07718766-b028-4d26-b4f5-d27bb4c7c873 admin admin] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:15:57.348026 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-07718766-b028-4d26-b4f5-d27bb4c7c873 admin admin] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:15:57.373639 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-07718766-b028-4d26-b4f5-d27bb4c7c873 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088029 Jun 28 03:15:57.374180 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 37/74] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jun 28 03:15:57 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:15:58.205772 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-d9cc650b-6dc6-44b0-8112-fd4b4c627e2f admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:15:58.207330 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-d9cc650b-6dc6-44b0-8112-fd4b4c627e2f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 Jun 28 03:15:58.208225 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 38/75] 10.222.0.44 () {56 vars in 1074 bytes} [Tue Jun 28 03:15:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:15:58.415427 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-50703ce8-4900-4944-bbba-376cd8c305b7 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:15:58.416629 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 28 03:15:58.416629 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Jun 28 03:15:58.417808 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-50703ce8-4900-4944-bbba-376cd8c305b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:15:58.418239 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-50703ce8-4900-4944-bbba-376cd8c305b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:15:58.419009 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-50703ce8-4900-4944-bbba-376cd8c305b7 admin admin] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:15:58.419423 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-50703ce8-4900-4944-bbba-376cd8c305b7 admin admin] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:15:58.440896 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-50703ce8-4900-4944-bbba-376cd8c305b7 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088632 Jun 28 03:15:58.441426 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 38/76] 10.222.0.44 () {60 vars in 1193 bytes} [Tue Jun 28 03:15:58 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:16:54.832662 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: Tue Jun 28 03:16:54 2022 - graceful shutdown triggered... Jun 28 03:16:54.832529 dv-cinder-846842-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 28 03:16:54.833655 dv-cinder-846842-5-iscsi devstack@n-api.service[103154]: Gracefully killing worker 2 (pid: 103154)... Jun 28 03:16:54.834407 dv-cinder-846842-5-iscsi devstack@n-api.service[103153]: Gracefully killing worker 1 (pid: 103153)... Jun 28 03:16:55.833741 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: worker 1 buried after 1 seconds Jun 28 03:16:55.833741 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: worker 2 buried after 1 seconds Jun 28 03:16:55.833741 dv-cinder-846842-5-iscsi devstack@n-api.service[103152]: goodbye to uWSGI. Jun 28 03:16:55.836278 dv-cinder-846842-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 28 03:16:55.837180 dv-cinder-846842-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 28 03:16:55.841642 dv-cinder-846842-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 28 03:16:55.856218 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 28 03:16:55.858591 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 28 03:16:55 2022] *** Jun 28 03:16:55.858591 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 28 03:16:55.858591 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 28 03:16:55.858591 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: nodename: dv-cinder-846842-5-iscsi Jun 28 03:16:55.858591 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: machine: x86_64 Jun 28 03:16:55.858591 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: clock source: unix Jun 28 03:16:55.858591 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: pcre jit disabled Jun 28 03:16:55.858591 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: detected number of CPU cores: 4 Jun 28 03:16:55.858591 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: current working directory: / Jun 28 03:16:55.858591 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: detected binary path: /usr/bin/uwsgi-core Jun 28 03:16:55.858591 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: your processes number limit is 47680 Jun 28 03:16:55.858591 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: your memory page size is 4096 bytes Jun 28 03:16:55.858591 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: detected max file descriptor number: 2048 Jun 28 03:16:55.859412 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: lock engine: pthread robust mutexes Jun 28 03:16:55.859412 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: thunder lock: enabled Jun 28 03:16:55.859412 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 28 03:16:55.859412 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 28 03:16:55.902960 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: Python main interpreter initialized at 0x556bca5c99c0 Jun 28 03:16:55.902960 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: python threads support enabled Jun 28 03:16:55.902960 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: your server socket listen backlog is limited to 100 connections Jun 28 03:16:55.902960 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: your mercy for graceful operations on workers is 90 seconds Jun 28 03:16:55.903447 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: mapped 403077 bytes (393 KB) for 2 cores Jun 28 03:16:55.903447 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: *** Operational MODE: preforking *** Jun 28 03:16:55.903694 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: *** uWSGI is running in multiple interpreter mode *** Jun 28 03:16:55.903694 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: spawned uWSGI master process (pid: 117662) Jun 28 03:16:55.903917 dv-cinder-846842-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 28 03:16:55.904499 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: spawned uWSGI worker 1 (pid: 117680, cores: 1) Jun 28 03:16:55.904855 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: spawned uWSGI worker 2 (pid: 117681, cores: 1) Jun 28 03:16:55.905201 dv-cinder-846842-5-iscsi devstack@n-api.service[117662]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 28 03:16:56.556181 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 28 03:16:56.559956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 28 03:16:57.723445 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 03:16:57.723445 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: from cryptography.utils import int_from_bytes Jun 28 03:16:57.724119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 03:16:57.724119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: from cryptography.utils import int_from_bytes Jun 28 03:16:57.770884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 03:16:57.770884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: from cryptography.utils import int_from_bytes Jun 28 03:16:57.771500 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 28 03:16:57.771500 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: from cryptography.utils import int_from_bytes Jun 28 03:17:00.097217 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 03:17:00.098028 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 03:17:00.098028 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 03:17:00.098453 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 03:17:00.098592 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 03:17:00.098901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.099249 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.099527 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.099855 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.100277 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.100557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.100823 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.101145 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.101482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.101744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.102051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.102431 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-5-iscsi {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.102691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.103057 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.103328 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.103608 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.103931 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.104237 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.104535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.105213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.106784 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.106784 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.106784 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.106784 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.107104 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.107211 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.107466 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.107772 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.108090 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.108422 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.108914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-5-iscsi {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.109167 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.109421 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.109728 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.110140 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.110468 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.110742 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.111057 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.111718 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.112055 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.112402 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.112721 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.113044 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.113377 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.113682 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.113981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.114289 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.114626 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.114899 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.115199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.115438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.115765 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.116054 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.116407 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.116707 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.116953 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.117202 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.117526 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.117840 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.118150 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.118438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.118749 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.119044 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.119331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.119623 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.119917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.120252 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.120632 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.120974 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.121261 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.121574 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.121871 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.122260 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.122500 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.122789 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.123140 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.123446 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.123769 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.124053 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.124391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.124690 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.124987 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.125296 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.125589 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.125914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.126207 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.126451 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.126726 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.127068 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.127326 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.127613 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.127908 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.128225 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.128519 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.128817 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.129129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.129402 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.129696 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.129995 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.130288 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.130969 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.130969 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.131293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.131437 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.131807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.132041 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.132364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.132662 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.132969 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.133450 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.133754 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.134054 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.134369 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.134670 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.134969 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.135280 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.135581 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.135905 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.136441 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.136774 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.137053 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.137366 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.137722 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.137969 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.138265 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.138564 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.138893 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.139156 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.139452 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.139746 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.140043 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.140374 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.140688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.140993 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.141289 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.141587 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.141899 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.142227 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.142548 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.142885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.143193 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.143514 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.143837 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.144147 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.144471 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.144776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.145092 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.145394 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.145698 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.145999 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.146307 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.146612 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.146931 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.147238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.147547 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.147854 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.148176 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.148480 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.148797 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.149112 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.149412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.149744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.150079 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.150420 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.150700 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.151027 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.151309 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.151765 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.152327 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.152651 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.152985 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.153294 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.153603 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.153909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.154216 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.154521 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.154822 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.155123 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.155452 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.155757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.156061 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.156389 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.156698 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.157001 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.157300 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.157601 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.157894 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.158788 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.158788 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.158788 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.159482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.159482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.159908 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.159908 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.160229 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.160539 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.160829 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.161135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.161433 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.161729 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.162030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.162333 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.162630 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.162951 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.163253 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.163550 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.163863 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.164187 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.164477 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.164783 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.165084 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.165385 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.165685 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.165991 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.166378 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.166688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.166993 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.167499 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.167832 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.168272 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.168602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.168923 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.169231 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.169538 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.169835 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.170130 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.170524 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.170821 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.171013 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.171311 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.171606 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.171901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.172221 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.172548 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.172834 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.173136 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.173433 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.173754 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.174011 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.174352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.174649 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.174988 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.175320 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.175633 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.175950 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.176275 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.176580 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.176884 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.177188 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.177490 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.177791 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.178302 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.178477 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.178707 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.179073 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.179327 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.179687 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.179978 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.180260 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.180570 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.180910 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.181234 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.181545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.181856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.182156 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.182463 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.182826 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.183162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.183561 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.184076 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.184306 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.184484 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.184797 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.185102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.185425 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.185730 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.186041 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.186373 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.186644 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.186973 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.187301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.187606 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.187909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.188259 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.188605 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.188848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.189263 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.189447 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.189854 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.190030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.190341 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.190642 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.191049 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.191240 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.191659 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.191848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.192144 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.192466 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.192843 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.193096 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.193399 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.193714 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.194050 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.194352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.194622 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.194936 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.195237 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.195531 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.195830 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.196126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.196514 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.196792 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.197089 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.197399 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.197713 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.198015 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.198325 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.198641 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.199146 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.199295 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.199607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.199834 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.200128 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.200465 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.200770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.201201 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.201398 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.201681 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.201985 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.202289 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.202594 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.202996 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.203207 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.203799 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.204246 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.204465 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.204777 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.205086 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.205395 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.205722 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.206042 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.206385 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.206685 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.206984 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.207281 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.207576 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.207884 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.208204 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.208505 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.208805 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.209270 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.209436 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.209741 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.212841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.212841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.212841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.212841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.212841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.212841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.212841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.212841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.214545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.214545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.214545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.214545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.214545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.214545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.214545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.215522 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.215522 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.215522 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.215940 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.216091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.216442 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.216808 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.217040 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.217340 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.217636 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.217941 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.218242 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.218544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.218845 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.219138 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.219467 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.219730 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.220031 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.220378 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.220676 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.220971 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.221273 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.221572 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.221866 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.222167 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.222462 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.223100 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.223100 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.223400 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.223676 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.223905 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.224234 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.224618 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.224853 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.225157 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.225454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.225750 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.226049 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.226345 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.226640 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.226949 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.227248 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.227558 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.227853 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.228169 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.228490 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.228789 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.229086 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.229387 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.229785 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.230186 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.230524 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.230823 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.231119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.231442 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.231744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.232573 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.232573 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.232800 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.232973 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.233279 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.233656 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.233932 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.234241 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.234553 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.234860 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.235167 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.235477 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.235776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.236085 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.236776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.237083 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.237386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.237680 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.237995 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.238298 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.238600 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.238913 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.239226 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.239541 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.239836 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.240144 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.240656 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.240962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.241266 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.241570 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.241873 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.242176 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.242482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.242788 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.243090 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.243391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.243694 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.243995 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.244325 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.244652 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.244958 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.245281 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.245591 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.245883 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.246185 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.246484 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.246926 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.247236 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.247540 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.247838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.248141 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.248556 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.248868 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.249181 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.249477 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.249893 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.250191 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.250678 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.250992 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.251292 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.251589 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.251955 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.252233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.252543 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.252842 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.253139 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.253455 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.253755 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.254067 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.254475 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.254780 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.255078 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.255483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.255786 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.256088 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.256429 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.256744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.257060 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.257357 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.257664 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.257966 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.258283 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.258596 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.258899 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.259207 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.259505 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.259818 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.260133 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.260479 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.261044 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.261452 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.261768 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.262073 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.262389 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.262711 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.263012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.263313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.263617 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.263914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.264237 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.264556 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.264856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.265159 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.265463 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.265765 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.266062 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.266360 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.266675 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.266974 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.267289 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.267596 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.267912 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.268264 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.268567 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.268880 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.269184 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.269480 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.269778 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.270071 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.270407 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.270704 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.271158 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.271493 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.271816 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.272120 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.272479 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.272802 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.273110 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.273422 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.273517 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 28 03:17:00.273929 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.274020 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 28 03:17:00.274107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.274319 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 28 03:17:00.274469 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.274632 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.274776 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 28 03:17:00.274958 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.275111 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 28 03:17:00.275255 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.275397 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.275560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.275702 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.275874 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.276029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.276220 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.276370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.276547 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.276722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.276957 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.277137 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.277365 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.277529 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.277674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.277832 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.277998 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.278142 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.278285 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.278427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.278578 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.278736 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.278912 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.279058 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.279210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.279365 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846842-5-iscsi {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.279518 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.279670 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.279814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.279955 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.280099 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.280285 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.280428 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.280588 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.280753 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.280896 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.281039 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.281192 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.281345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.281515 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.282171 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.282344 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.282520 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.282672 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.282832 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.282976 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.283130 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.283274 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.283416 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.283642 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.283804 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.283953 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.284110 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.284309 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.284469 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.284631 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.284781 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.284929 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.286144 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.286309 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.286470 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.286628 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.286628 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846842-5-iscsi {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.286933 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.287084 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.287241 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.287391 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.287541 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.287699 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.287871 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.287871 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.288175 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.288343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.288503 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.288667 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.288667 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.288959 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.289108 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.289265 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.289415 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.289575 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.289724 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.289885 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.290048 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.290208 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.290368 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.290518 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.290667 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.290815 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.290963 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.291122 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.291281 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.291431 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.291579 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.291746 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.292687 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.292852 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.293013 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.293172 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.293321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.293483 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.293483 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.293806 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.293965 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.294124 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.294274 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.294434 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.294582 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.294741 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.294741 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.294741 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.295158 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.295315 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.295473 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.295637 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.295787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.295939 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.296088 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.296273 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.296441 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.296594 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.296742 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.296894 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.297063 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.297227 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.297377 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.297534 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.297683 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.297872 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.298034 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.298206 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.298357 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.298507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.298654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.298820 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.298973 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.299131 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.299289 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.299289 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.299590 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.299739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.299897 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.300067 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.300268 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.300431 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.300589 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.300687 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.300790 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.300903 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.300990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.301081 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.301173 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.301264 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.301363 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.301443 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.301523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.301596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.301679 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.301679 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.301843 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.301936 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.302042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.302265 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.302637 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.302757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.302840 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.302925 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.303015 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.303105 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.303189 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.303279 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.303363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.303446 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.303528 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.303609 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.303693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.303693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.303860 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.303943 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.304024 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.304115 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.304229 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.304324 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.304415 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.304501 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.304594 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.304686 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.304779 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.304874 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.304964 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.305151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.305245 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.305453 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.305559 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.305758 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.305856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.306062 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.306161 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.306365 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.306508 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.306663 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.306762 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.306965 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.307064 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.307266 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.307367 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.307560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.307649 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.307893 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.308068 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.308227 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.308515 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.308794 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.308896 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.309086 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.309176 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.309381 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.309464 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.309685 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.309786 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.309979 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.310101 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.310279 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.310474 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.310638 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.310805 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.310959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.311110 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.311271 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.311412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.311574 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.311731 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.311883 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.312021 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.312202 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.312340 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.312476 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.312731 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.312962 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.313127 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.313288 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.313288 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.313631 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.313783 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.313931 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.314090 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.314238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.314238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.314516 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.314663 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.314802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.314941 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.315078 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.315219 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.315369 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.315507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.315646 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.315797 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.315942 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.315942 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.316353 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.316519 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.316655 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.316801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.316947 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.317095 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.317242 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.317378 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.317524 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.317673 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.317818 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.317973 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.318119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.318265 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.318401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.318545 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.318693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.318844 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.318985 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.319131 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 28 03:17:00.319281 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.319414 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.319551 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.319712 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.319879 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.320021 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.320183 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.320320 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.320535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.320682 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.320823 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.320960 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.321106 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.321207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.321306 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.321441 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.321526 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.321614 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.321696 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.321939 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.322042 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.322252 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.322343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.322549 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.322628 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.322860 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.323179 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.323645 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.323817 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.324135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.324499 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.324596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.324817 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.324906 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.325132 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.325221 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.325446 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.325542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.325760 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.325849 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.326063 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.326150 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.326495 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.326600 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.326799 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.327101 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.327413 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.327735 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.327989 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.328081 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.328352 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.328458 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.328718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.328865 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.329077 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.329179 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.329403 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.329503 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.329746 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.329846 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.330055 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.330138 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.330370 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.330471 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.330684 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.330789 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.330986 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.331077 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.331299 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.331392 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.331604 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.331705 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.331924 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.332024 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.333165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.333290 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.333395 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.333494 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.333583 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.333671 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.333755 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.333848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.333942 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.334044 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.334130 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.334219 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.334305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.334387 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.334485 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.334578 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.334701 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.335028 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.335028 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.335268 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.335375 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.335474 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.335560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.335644 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.335859 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.336010 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.336196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.336301 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.336468 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.336568 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.336764 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.336878 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.337068 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.337226 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.337371 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.337512 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.337669 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.337821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.337961 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.338100 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.338238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.338386 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.338535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.338683 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.338832 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.338999 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.339137 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.339387 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.339682 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.339836 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.339986 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.340127 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.340286 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.340391 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.340586 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.340687 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.340910 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.341004 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.341236 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.341329 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.341545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.341639 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.341850 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.341948 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.342158 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.342255 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.342474 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.342574 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.342776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.342867 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.343090 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.343188 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.343397 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.343488 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.343700 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.343808 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.343999 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.344098 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.344347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.344444 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.344649 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.344748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.344948 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.345059 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.345246 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.345339 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.345547 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.345646 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.345846 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.345952 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.346148 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.346248 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.346464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.346564 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.346780 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.346872 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.347077 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.347176 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.347436 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.347551 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.347700 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.347793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.348009 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.348100 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.348356 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.348460 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.348656 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.348754 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.348958 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.349057 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.349262 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.349368 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.349563 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.349654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.349868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.349968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.350165 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.350264 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.350465 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.350565 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.350764 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.350862 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.351066 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.351159 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.351370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.351462 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.351685 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.351782 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.351992 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.352091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.352322 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.352429 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.352628 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.352730 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.352930 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.353029 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.353248 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.353345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.353565 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.353690 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.353884 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.353979 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.354188 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.354281 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.354491 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.354721 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.354910 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.355082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.355179 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117681) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 03:17:00.355431 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.355835 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.356168 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.356485 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.356798 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.357110 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.357432 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.357745 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.358063 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.358372 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.358697 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.359010 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.359328 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.359632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.359947 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.360311 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.360645 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.360961 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.361633 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.361944 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.362259 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.362569 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.362879 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.363187 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.363496 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.363812 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.364120 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.364461 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.364771 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.365094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.365403 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.365720 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.366024 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.366339 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.366666 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.366996 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.367305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.367614 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.367934 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.368272 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.368583 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.368900 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.369206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.369512 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.369821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.370136 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.371072 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.371379 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.371689 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.372006 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.372349 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.372661 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.373068 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.373269 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.373649 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.373976 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.374282 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.374606 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.374913 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.375219 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.375543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.375854 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.376224 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.376484 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.376787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.377314 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.377799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.378269 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.378752 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.379265 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.379753 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.380329 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.380767 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.381505 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.381732 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.382625 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.382751 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.383148 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.383669 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.384190 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.384694 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.385204 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.385648 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.386415 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.386659 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.387424 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.387596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.388066 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.389014 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.389496 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.389986 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.390503 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.390956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.391518 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.391954 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.392490 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.393020 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.393494 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.393973 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.394446 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.394913 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.395392 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.395858 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.396370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.396843 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.397317 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.397784 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.398252 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.398728 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.399197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.399683 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.400168 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.400653 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.401121 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.401643 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.402122 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.402585 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.403056 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.403583 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.404209 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.404762 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.405357 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.405936 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.406549 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.407100 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.407668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.408270 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.408824 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.409364 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.409913 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.410451 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.411011 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.411537 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.412108 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.412688 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.413242 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.413799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.414373 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.414789 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.415102 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.415464 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.415744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.416053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.416390 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.416704 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.417003 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO dbcounter [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] Registered counter for database nova_api Jun 28 03:17:00.417218 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.417543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.418265 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.418589 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.418920 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.419238 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.419553 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.419864 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.420208 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.420521 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.420832 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.421169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.421485 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.421795 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.422098 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.422414 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.422718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.423028 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.423332 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.423656 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.423978 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.424382 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.424926 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.425386 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.425752 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.426237 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.426743 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.427060 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.427372 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.427682 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.427992 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.428336 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.428683 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.428981 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.429289 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.429595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.429901 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.430252 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.430560 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.430926 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.431234 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.431554 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.431877 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.432231 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.432534 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.434002 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.434654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.435152 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.435478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.435802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.436114 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.436449 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.436781 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.437101 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.437417 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.437745 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.438071 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.438399 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.438712 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.438807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_db.sqlalchemy.engines [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:17:00.439025 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.439338 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.439645 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.439957 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.440378 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.440693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.441007 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.441329 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.441696 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.441949 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.442260 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.442573 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.442885 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.443193 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.443538 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.443834 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.444139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.444471 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.444778 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.445091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.445399 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.445560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writer thread running {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:17:00.445847 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.446156 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.446470 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.446778 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.447091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.447404 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.447721 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.448041 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.448429 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.449478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.449800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.450116 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.450433 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.450742 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.451172 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.451351 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.451678 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.451988 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.452320 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.452629 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.452954 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.453263 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.453585 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.453998 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.454312 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.454618 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.455049 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.455349 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.455661 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.455985 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.456346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.456666 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.456969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.457286 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.457600 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.457927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.458251 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.458564 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.458889 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.459196 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.459521 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.459845 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.460183 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.460508 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.460918 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.461241 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.461551 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.461878 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.462297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.462518 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.462823 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.463138 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.463444 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.463753 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.464175 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.464980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.465336 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.465626 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.465944 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.466256 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.466567 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.466897 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.467205 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.467535 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.467854 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.468202 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.468529 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.468838 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.469170 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.469480 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.469787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.470093 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.470399 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.470745 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.471050 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.471374 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.471707 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.472037 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.472373 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.472709 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.473038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.473355 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.473673 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.473999 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.474306 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.474613 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.474926 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.475233 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.475542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.475847 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.476179 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.476489 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.476802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.477094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.477418 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.477723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.478047 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.478359 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.478663 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.478975 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.479280 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.479679 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.480488 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.480840 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.481172 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.481504 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.481839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.482155 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.482483 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.482803 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.483122 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.483438 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.483755 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.484071 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.484414 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.484731 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.485041 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.485356 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.485675 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.485992 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.486914 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.487241 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.487559 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.487874 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.488207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.488525 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.488839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.489156 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.489468 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.489780 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.490092 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.490421 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.490743 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.491069 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.491404 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.491722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.492038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.492378 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.492696 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.493053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.493368 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.493676 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.493990 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.494310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.494625 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.494938 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.495284 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.496120 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.496461 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.496778 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.497093 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.497410 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.497726 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.498057 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.498394 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.498717 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.499033 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.499350 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.499671 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.500217 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.500539 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.500871 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.501197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.501329 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.context [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e98e3abb-bf26-4fd3-abd9-1f639c67dc6f(cell1) {{(pid=117681) load_cells /opt/stack/nova/nova/context.py:464}} Jun 28 03:17:00.501521 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.501839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.502155 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.502482 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.502788 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.503094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.503405 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.503714 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.504019 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.504372 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.504682 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.504986 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.505304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.505442 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:17:00.505613 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.506148 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.506495 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.506814 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.506956 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:17:00.507135 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.507458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.507737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:17:00.507840 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.508067 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.508417 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.508722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.509027 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.509347 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.509655 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.509755 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:17:00.509959 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.510266 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.510582 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.510963 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.511697 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO dbcounter [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] Registered counter for database nova_cell0 Jun 28 03:17:00.511823 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.512135 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.512463 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.512796 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.513183 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.513403 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.513882 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.514045 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.514342 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.514621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.514977 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.515325 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.515608 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.515724 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO dbcounter [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] Registered counter for database nova_cell1 Jun 28 03:17:00.515978 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.516250 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.516560 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.516911 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.517214 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.517569 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.517892 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.518220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.518530 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.518836 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.519154 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.519467 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.519794 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.520110 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.520446 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.520798 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.521116 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.521676 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.522014 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.522337 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.522673 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.523006 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.523180 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_db.sqlalchemy.engines [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:17:00.523314 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.523608 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.523913 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.524264 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.524579 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.524891 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.525203 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.525517 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.525827 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.526141 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.526456 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.526869 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.526998 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_db.sqlalchemy.engines [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:17:00.527738 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.528055 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.528394 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.528708 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.528961 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writer thread running {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:17:00.529102 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.529325 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.529674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.530001 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.530324 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.530644 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.530958 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.531269 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.531578 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.531890 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.532219 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.532536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.532867 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.533180 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.533488 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.534012 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.534323 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.534641 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.534959 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.535268 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.535589 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.535910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.536243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.536561 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.536872 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.537199 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.537539 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.537866 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.538194 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.538499 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.538804 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.539109 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.539417 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.539735 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.540048 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.540377 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.540682 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.540995 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.541299 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.541604 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.541909 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.542354 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.543030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.543344 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.543656 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.543968 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.544301 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.544612 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.544920 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.545233 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.545539 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.545847 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.546152 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.546462 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.546765 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.547095 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.547436 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.547754 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.548077 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.548449 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.548777 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.549088 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.549414 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.549737 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.550058 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.550374 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.550705 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.551015 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.551325 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.551634 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.551943 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.552272 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.552586 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.552913 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.553240 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.553544 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.553871 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.554189 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.554507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.554823 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.555132 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.555462 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.555771 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.556080 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.556419 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.556732 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.557042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.557356 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.557669 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.558577 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.558924 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.559243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.559575 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.559907 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.560283 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.560604 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.560951 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.561281 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.561597 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.561911 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.562221 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 28 03:17:00.562463 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 28 03:17:00.627877 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO dbcounter [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] Registered counter for database nova_api Jun 28 03:17:00.648665 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_db.sqlalchemy.engines [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:17:00.656439 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writer thread running {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:17:00.670393 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writer thread running {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:17:00.679325 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO dbcounter [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] Registered counter for database nova_cell0 Jun 28 03:17:00.686614 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_db.sqlalchemy.engines [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117681) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:17:00.691577 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writer thread running {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:17:00.714890 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.context [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e98e3abb-bf26-4fd3-abd9-1f639c67dc6f(cell1) {{(pid=117680) load_cells /opt/stack/nova/nova/context.py:464}} Jun 28 03:17:00.719018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:17:00.720661 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:17:00.721457 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:17:00.723417 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:17:00.725471 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO dbcounter [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] Registered counter for database nova_cell0 Jun 28 03:17:00.729559 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO dbcounter [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] Registered counter for database nova_cell1 Jun 28 03:17:00.739544 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_db.sqlalchemy.engines [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:17:00.740390 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_db.sqlalchemy.engines [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:17:00.747821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writer thread running {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:17:00.750551 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writer thread running {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:17:00.906049 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO dbcounter [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] Registered counter for database nova_cell0 Jun 28 03:17:00.913030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_db.sqlalchemy.engines [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 28 03:17:00.919236 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writer thread running {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 28 03:17:01.003507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: WARNING keystonemiddleware.auth_token [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 03:17:01.010713 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: WARNING keystonemiddleware.auth_token [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 03:17:01.246266 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: WARNING keystonemiddleware.auth_token [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 03:17:01.254281 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: WARNING keystonemiddleware.auth_token [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 03:17:01.352127 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: WARNING keystonemiddleware.auth_token [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 03:17:01.358425 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: WARNING keystonemiddleware.auth_token [None req-a309f7fb-d0ce-4758-aac9-b55c1241ea79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 03:17:01.364073 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bca5c99c0 pid: 117681 (default app) Jun 28 03:17:01.600882 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: WARNING keystonemiddleware.auth_token [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 28 03:17:01.607085 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: WARNING keystonemiddleware.auth_token [None req-27293ee6-cd3e-46b7-941e-632988d64507 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 28 03:17:01.612775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bca5c99c0 pid: 117680 (default app) Jun 28 03:17:40.775024 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=3 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:40.776090 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=3 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:40.777420 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=3 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:40.778538 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=3 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:41.931607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c797d730-c09c-4b7e-b557-56eb78a7e9e2 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Action: 'create', calling method: .version_select at 0x7f53f3b4a310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-817119204"}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:17:42.024388 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:42.026425 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:42.027420 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:42.029593 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:17:43.663635 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9039c352-ad73-4d33-b8fb-b7de7f680bff tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] Action: 'create', calling method: .version_select at 0x7f53f3b4d280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-765745312", "metadata": {"Type": "work"}}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:17:44.370888 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c797d730-c09c-4b7e-b557-56eb78a7e9e2 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.615904 Jun 28 03:17:44.371952 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1154 bytes} [Tue Jun 28 03:17:40 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3618 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 28 03:17:44.383672 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-67ae6036-fa41-4e9f-a2ad-bc6e44ca1e79 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f3a201f0>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:44.756050 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-67ae6036-fa41-4e9f-a2ad-bc6e44ca1e79 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b" status: 200 len: 344 microversion: 2.1 time: 0.373213 Jun 28 03:17:44.757464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 2/2] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:44 2022] GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b => generated 344 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:45.250085 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9039c352-ad73-4d33-b8fb-b7de7f680bff tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.231577 Jun 28 03:17:45.250716 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Jun 28 03:17:42 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3234 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 28 03:17:45.263640 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7aefdb9f-0398-4a41-a616-5c73ad4cd038 tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] Calling method '.version_select at 0x7f53f3a204c0>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:45.403728 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7aefdb9f-0398-4a41-a616-5c73ad4cd038 tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80" status: 200 len: 352 microversion: 2.1 time: 0.144779 Jun 28 03:17:45.405205 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 3/4] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:45 2022] GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80 => generated 352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:45.771701 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2e36f9f3-f733-4dd5-860e-f2efbb2c6ef4 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f3a22160>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:45.843424 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2e36f9f3-f733-4dd5-860e-f2efbb2c6ef4 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b" status: 200 len: 345 microversion: 2.1 time: 0.076439 Jun 28 03:17:45.852507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 2/5] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:45 2022] GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:45.857489 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3e536d88-aded-4b63-bc92-f63fb80cb5a1 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Action: 'create', calling method: .version_select at 0x7f53f3a20940>, body: {"snapshot": {"volume_id": "543d5358-ad6c-4d13-bc48-2a6e42ae555b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1090410981"}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:17:46.215961 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4e12f08b-49da-4325-80c5-a5a0d09b3837 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] Calling method '.version_select at 0x7f53f3a223a0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:46.223487 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3e536d88-aded-4b63-bc92-f63fb80cb5a1 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.371006 Jun 28 03:17:46.224357 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 4/6] 10.222.0.44 () {60 vars in 1161 bytes} [Tue Jun 28 03:17:45 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:46.234750 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3649f8f3-89c2-452e-bba4-ed01488becdd tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f3a285e0>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:46.309767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3649f8f3-89c2-452e-bba4-ed01488becdd tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e" status: 200 len: 287 microversion: 2.1 time: 0.078748 Jun 28 03:17:46.310570 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 5/7] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 28 03:17:46 2022] GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:46.311048 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4e12f08b-49da-4325-80c5-a5a0d09b3837 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1b820610-8dfa-4e82-878c-9162b12e1c5d" status: 200 len: 351 microversion: 2.1 time: 0.100174 Jun 28 03:17:46.311875 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 3/8] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:46 2022] GET /compute/v2.1/os-volumes/1b820610-8dfa-4e82-878c-9162b12e1c5d => generated 351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:17:46.333488 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ccafaa94-3079-4956-9f5e-8e4ac780dd9a tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f3a20ee0>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:46.422870 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-df2bb27e-44ff-4970-a34f-d70e8f1a8445 tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] Calling method '.version_select at 0x7f53f3a229d0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:46.427788 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ccafaa94-3079-4956-9f5e-8e4ac780dd9a tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.101220 Jun 28 03:17:46.432341 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 6/9] 10.222.0.44 () {58 vars in 1139 bytes} [Tue Jun 28 03:17:46 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:46.440333 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ab0367ee-11d1-45aa-a6e6-1ac49b2b7fa7 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f3a28280>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:46.518822 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ab0367ee-11d1-45aa-a6e6-1ac49b2b7fa7 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e" status: 200 len: 287 microversion: 2.1 time: 0.082901 Jun 28 03:17:46.520011 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 7/10] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 28 03:17:46 2022] GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:46.581600 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-df2bb27e-44ff-4970-a34f-d70e8f1a8445 tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80" status: 200 len: 353 microversion: 2.1 time: 0.163145 Jun 28 03:17:46.591565 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 4/11] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:46 2022] GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80 => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:46.595625 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b4c739f9-154b-4f14-aaff-e57de372cd3d tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] Calling method '.version_select at 0x7f53f3a28430>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:46.750922 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b4c739f9-154b-4f14-aaff-e57de372cd3d tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80" status: 200 len: 353 microversion: 2.1 time: 0.159428 Jun 28 03:17:46.762443 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 8/12] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:46 2022] GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80 => generated 353 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:46.770728 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-62a386af-c8b6-403c-8fca-99c2c51e961b tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] Calling method '.version_select at 0x7f53f3a280d0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:47.063572 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-62a386af-c8b6-403c-8fca-99c2c51e961b tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80" status: 202 len: 0 microversion: 2.1 time: 0.298476 Jun 28 03:17:47.064607 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 5/13] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 28 03:17:46 2022] DELETE /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:17:47.075225 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-499066ea-c419-4112-b3f9-0ca88a15d3f9 tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] Calling method '.version_select at 0x7f53f3a20550>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:47.305288 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-499066ea-c419-4112-b3f9-0ca88a15d3f9 tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80" status: 200 len: 352 microversion: 2.1 time: 0.236261 Jun 28 03:17:47.305987 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 9/14] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:47 2022] GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80 => generated 352 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:47.543114 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-57d8407c-0624-4d42-a28e-29098726db7d tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f3a22ee0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:47.603444 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-57d8407c-0624-4d42-a28e-29098726db7d tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e" status: 200 len: 287 microversion: 2.1 time: 0.066098 Jun 28 03:17:47.604375 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 6/15] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 28 03:17:47 2022] GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:48.318506 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6f14e390-410a-4865-8de7-ab86a5efa347 tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] Calling method '.version_select at 0x7f53f3a20af0>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:48.409011 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6f14e390-410a-4865-8de7-ab86a5efa347 tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80" status: 200 len: 352 microversion: 2.1 time: 0.094131 Jun 28 03:17:48.409707 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 10/16] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:48 2022] GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:48.616998 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-eb1dbf69-e4c0-4ae9-9f05-d976cb769325 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f3a225e0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:48.682041 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-eb1dbf69-e4c0-4ae9-9f05-d976cb769325 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e" status: 200 len: 287 microversion: 2.1 time: 0.070862 Jun 28 03:17:48.683111 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 7/17] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 28 03:17:48 2022] GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:49.424671 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-23464f55-8c39-4bfb-9501-b10d7e3edfcf tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] Calling method '.version_select at 0x7f53f3a28af0>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:49.529205 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-23464f55-8c39-4bfb-9501-b10d7e3edfcf tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80" status: 200 len: 352 microversion: 2.1 time: 0.108206 Jun 28 03:17:49.534456 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 11/18] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:49 2022] GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:49.693911 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d416c2aa-7899-4bb8-93b6-5f8a4115f707 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f3a285e0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:49.766073 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d416c2aa-7899-4bb8-93b6-5f8a4115f707 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e" status: 200 len: 287 microversion: 2.1 time: 0.072607 Jun 28 03:17:49.766877 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 8/19] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 28 03:17:49 2022] GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:50.502463 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-af0fa432-667a-4cf5-bd8c-4d7aa3312388 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] Calling method '.version_select at 0x7f53f3a28820>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:50.544572 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1629f929-2214-48bc-b5af-e142a5de6f8c tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] Calling method '.version_select at 0x7f53f3a223a0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:50.597067 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-1629f929-2214-48bc-b5af-e142a5de6f8c tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] HTTP exception thrown: Volume b5f096ac-0c1f-49c8-a0c5-d06865343a80 could not be found. Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1629f929-2214-48bc-b5af-e142a5de6f8c tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] Request method failure captured: Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80 HTTP/1.1 Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunLVHoYQp8qXDywc4c0drxCTpQ8YYSqEysuC5P_YDQp8yK41mFNA-Zw-rw_adzvR3z4iDXiDvgEuinec-gNL6O0DbXLbftxvA-4Xb-6avXUCi4LWIDt8kb5ttGPlsPaloF72o6UYexVvCcRGHCZ7ZGNTb2d83w7KOXAOaQHK9br-jaA Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 33ecd10ff6a64a89b09a2076bc35b52f Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesGetTestJSON-406422937 Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:17:50.603654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:17:50.605243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_33ecd10ff6a64a89b09a2076bc35b52f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/33ecd10ff6a64a89b09a2076bc35b52f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/33ecd10ff6a64a89b09a2076bc35b52f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/33ecd10ff6a64a89b09a2076bc35b52f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:17:50.605243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesGetTestJSON-406422937 Jun 28 03:17:50.605243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 33ecd10ff6a64a89b09a2076bc35b52f Jun 28 03:17:50.605243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesGetTestJSON-406422937 Jun 28 03:17:50.605243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesGetTestJSON-406422937-project Jun 28 03:17:50.605243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:17:50.605243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:17:50.605243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: f17872f769f34d0bae6b6cb63ac6d6fc Jun 28 03:17:50.605243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesGetTestJSON-406422937-project Jun 28 03:17:50.605243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: Jun 28 03:17:50.605243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Volume b5f096ac-0c1f-49c8-a0c5-d06865343a80 could not be found. Jun 28 03:17:50.605243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': 'b5f096ac-0c1f-49c8-a0c5-d06865343a80'} Jun 28 03:17:50.605243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b5f096ac-0c1f-49c8-a0c5-d06865343a80 could not be found. (HTTP 404) (Request-ID: req-8390c005-2a01-4ca8-a329-f29a2294606b) Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:50.606082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 03:17:50.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b5f096ac-0c1f-49c8-a0c5-d06865343a80 could not be found. Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 28 03:17:50.609304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:17:50.610380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b5f096ac-0c1f-49c8-a0c5-d06865343a80 could not be found. Jun 28 03:17:50.610380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:50.610380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:50.610380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:50.610380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:50.610380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:17:50.610380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:17:50.610380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:17:50.610380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:17:50.610380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b5f096ac-0c1f-49c8-a0c5-d06865343a80 could not be found. Jun 28 03:17:50.610380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:50.613827 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1629f929-2214-48bc-b5af-e142a5de6f8c tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] Returning 404 to user: Volume b5f096ac-0c1f-49c8-a0c5-d06865343a80 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:17:50.614921 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1629f929-2214-48bc-b5af-e142a5de6f8c tempest-VolumesGetTestJSON-406422937 tempest-VolumesGetTestJSON-406422937-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80" status: 404 len: 109 microversion: 2.1 time: 0.076134 Jun 28 03:17:50.615990 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 9/20] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:50 2022] GET /compute/v2.1/os-volumes/b5f096ac-0c1f-49c8-a0c5-d06865343a80 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 03:17:50.626529 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-af0fa432-667a-4cf5-bd8c-4d7aa3312388 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/80697128-f2d7-47e1-9b94-a96a9804ec04" status: 200 len: 350 microversion: 2.1 time: 0.124138 Jun 28 03:17:50.633557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 12/21] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:50 2022] GET /compute/v2.1/os-volumes/80697128-f2d7-47e1-9b94-a96a9804ec04 => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:50.779851 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d2cf2ef1-7b5e-4e7d-8e13-a7e5d707e102 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f4387700>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:50.829903 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d2cf2ef1-7b5e-4e7d-8e13-a7e5d707e102 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e" status: 200 len: 288 microversion: 2.1 time: 0.055752 Jun 28 03:17:50.831181 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 10/22] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 28 03:17:50 2022] GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e => generated 288 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:50.844308 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f890ac46-800b-4e0b-822b-a04d2aa380fb tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f3a28280>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:50.970625 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f890ac46-800b-4e0b-822b-a04d2aa380fb tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e" status: 202 len: 0 microversion: 2.1 time: 0.130557 Jun 28 03:17:50.972885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 13/23] 10.222.0.44 () {58 vars in 1253 bytes} [Tue Jun 28 03:17:50 2022] DELETE /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:17:51.005289 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5d264ce7-54c8-4f82-abef-bad38bf386ae tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f3a221f0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:51.072880 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5d264ce7-54c8-4f82-abef-bad38bf386ae tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e" status: 200 len: 287 microversion: 2.1 time: 0.094566 Jun 28 03:17:51.074652 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 11/24] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 28 03:17:50 2022] GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:51.627676 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f1d1d61b-c93b-4e06-98fe-fc4ce40d91db tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Action: 'create', calling method: .version_select at 0x7f53f3a28160>, body: {"keypair": {"name": "tempest-keypair-728925176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA5PSuiZGJeXuuKCc811UglvSu5CS/7eUJEkQ7GSQqMUY+2TJJmXiNdrZ1CCkdQAmDVBJwPrFwtueksO6s8HC0uLjIWgS9eEPhahNRmvDCRqhQCWvGqtHvwZBoRDPdziw=="}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:17:51.736177 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-f1d1d61b-c93b-4e06-98fe-fc4ce40d91db tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Getting quotas for project 9e47b6f7a96c46dfa9906912efb7f265. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:17:51.754131 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-f1d1d61b-c93b-4e06-98fe-fc4ce40d91db tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Getting quotas for user 1f5f5b39c16f4cb38c12c33252786cc5 and project 9e47b6f7a96c46dfa9906912efb7f265. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:17:51.850983 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f1d1d61b-c93b-4e06-98fe-fc4ce40d91db tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.460091 Jun 28 03:17:51.852287 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 14/25] 10.222.0.44 () {62 vars in 1199 bytes} [Tue Jun 28 03:17:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 462 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 28 03:17:52.085966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-68fbdfac-4d4a-45b6-b7b0-74031e35208e tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f39931f0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:52.131853 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-68fbdfac-4d4a-45b6-b7b0-74031e35208e tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] HTTP exception thrown: Snapshot b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e could not be found. Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-68fbdfac-4d4a-45b6-b7b0-74031e35208e tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Request method failure captured: Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e HTTP/1.1 Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunLUXXGnl0z5K17WCgEjmTcNtcd_LBr4gXxajC7UPbSGh38Y2FvROl5aQtZ1jMsVVzmhg6gKv83WbxQceNscOcVBfn5WpgfOtecePC_7joJb81VAOqvwsmPx9DVDCgZgF7cu7vfy5A0QjzaMYidWGJdOtKkzdfPhFYOZAFglB5xZWtM Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 88d296a918584c77b39af3c24655eeaf Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1069532400 Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:17:52.134632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:17:52.135711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_88d296a918584c77b39af3c24655eeaf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/88d296a918584c77b39af3c24655eeaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/88d296a918584c77b39af3c24655eeaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/88d296a918584c77b39af3c24655eeaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:17:52.135711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1069532400 Jun 28 03:17:52.135711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 88d296a918584c77b39af3c24655eeaf Jun 28 03:17:52.135711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1069532400 Jun 28 03:17:52.135711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesSnapshotsTestJSON-1069532400-project Jun 28 03:17:52.135711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:17:52.135711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:17:52.135711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 4c80f79ae89c42c69ac124966a46c73a Jun 28 03:17:52.135711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1069532400-project Jun 28 03:17:52.135711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: Jun 28 03:17:52.135711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Snapshot b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e could not be found. Jun 28 03:17:52.135711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': 'b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e'} Jun 28 03:17:52.135711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e could not be found. (HTTP 404) (Request-ID: req-55cead3a-d849-4f8d-800f-bdb2703e6f58) Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:52.138257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 03:17:52.139165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e could not be found. Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 28 03:17:52.140147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:17:52.141427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e could not be found. Jun 28 03:17:52.141427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:52.141427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:52.141427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:52.141427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:52.141427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:17:52.141427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:17:52.141427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:17:52.141427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:17:52.141427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e could not be found. Jun 28 03:17:52.141427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:17:52.142978 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-68fbdfac-4d4a-45b6-b7b0-74031e35208e tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Returning 404 to user: Snapshot b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:17:52.144116 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-68fbdfac-4d4a-45b6-b7b0-74031e35208e tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e" status: 404 len: 111 microversion: 2.1 time: 0.062275 Jun 28 03:17:52.145164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 12/26] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 28 03:17:52 2022] GET /compute/v2.1/os-snapshots/b74eccd8-1a3e-49aa-b736-6fb3e54b1a3e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:17:52.154460 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6b01a2da-5e4d-4715-811a-d350b313d632 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f3992160>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:52.296268 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6b01a2da-5e4d-4715-811a-d350b313d632 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b" status: 202 len: 0 microversion: 2.1 time: 0.146185 Jun 28 03:17:52.297622 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 15/27] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 28 03:17:52 2022] DELETE /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 03:17:52.308057 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-42a53f3d-9d7a-4c64-8497-0a5f54175f84 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f3a220d0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:52.483659 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6666c119-fda8-4a21-acdd-7909829f5703 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] Calling method '.version_select at 0x7f53f3992ee0>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:52.485516 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-42a53f3d-9d7a-4c64-8497-0a5f54175f84 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b" status: 200 len: 344 microversion: 2.1 time: 0.182944 Jun 28 03:17:52.486566 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 13/28] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:52 2022] GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b => generated 344 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:52.594915 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6666c119-fda8-4a21-acdd-7909829f5703 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2839e5f6-eb15-47d4-98b5-574dd28210da" status: 200 len: 350 microversion: 2.1 time: 0.114486 Jun 28 03:17:52.594915 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 16/29] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:52 2022] GET /compute/v2.1/os-volumes/2839e5f6-eb15-47d4-98b5-574dd28210da => generated 350 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:17:52.606513 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2bb4661f-7927-414f-b897-1e218b8a77f2 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] Calling method '.version_select at 0x7f53f3a28ee0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:52.851170 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2bb4661f-7927-414f-b897-1e218b8a77f2 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.249031 Jun 28 03:17:52.852456 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 14/30] 10.222.0.44 () {58 vars in 1133 bytes} [Tue Jun 28 03:17:52 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:17:52.865623 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b04e2ace-5e83-4067-a269-8d36e5f55c37 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] Calling method '.version_select at 0x7f53f313e430>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:53.092696 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b04e2ace-5e83-4067-a269-8d36e5f55c37 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.231639 Jun 28 03:17:53.093871 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 17/31] 10.222.0.44 () {58 vars in 1148 bytes} [Tue Jun 28 03:17:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:53.107487 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2d235ef5-b6c8-4e62-8663-cacf347beaf8 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] Calling method '.version_select at 0x7f53f39934c0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:53.385891 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2d235ef5-b6c8-4e62-8663-cacf347beaf8 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.282150 Jun 28 03:17:53.386487 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 15/32] 10.222.0.44 () {58 vars in 1133 bytes} [Tue Jun 28 03:17:53 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:17:53.412734 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3d125b82-3f64-4afb-b987-dcc5eabe6fe4 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] Calling method '.version_select at 0x7f53f3987f70>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:53.498350 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-58c5611f-8a05-49ea-8dcd-260f766a97f3 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f39b2670>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:53.641825 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-58c5611f-8a05-49ea-8dcd-260f766a97f3 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b" status: 200 len: 344 microversion: 2.1 time: 0.147398 Jun 28 03:17:53.642830 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 16/33] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:53 2022] GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b => generated 344 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:53.728839 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3d125b82-3f64-4afb-b987-dcc5eabe6fe4 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.328795 Jun 28 03:17:53.737174 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 18/34] 10.222.0.44 () {58 vars in 1166 bytes} [Tue Jun 28 03:17:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:53.747513 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ccd58ffa-64dc-4af7-989d-efe3b98856bb tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] Calling method '.version_select at 0x7f53f3993310>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:53.983124 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ccd58ffa-64dc-4af7-989d-efe3b98856bb tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.243924 Jun 28 03:17:53.983760 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 17/35] 10.222.0.44 () {58 vars in 1169 bytes} [Tue Jun 28 03:17:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:17:53.999114 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e2f3cb6b-c9ec-43b5-9c33-048b4a8e54bf tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] Calling method '.version_select at 0x7f53f313ed30>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:54.190683 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e2f3cb6b-c9ec-43b5-9c33-048b4a8e54bf tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.198161 Jun 28 03:17:54.191242 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 19/36] 10.222.0.44 () {58 vars in 1154 bytes} [Tue Jun 28 03:17:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:17:54.210407 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ea49bfda-7c59-4b8a-9f41-2cf5d7ded3fb tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] Calling method '.version_select at 0x7f53f3a28a60>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:54.457156 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ea49bfda-7c59-4b8a-9f41-2cf5d7ded3fb tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.258338 Jun 28 03:17:54.458314 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 18/37] 10.222.0.44 () {58 vars in 1187 bytes} [Tue Jun 28 03:17:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:54.475176 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-dc2354fb-31d7-4370-a3ec-f39a82fb41d7 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] Calling method '.version_select at 0x7f53f313e160>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:54.655580 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bfffde91-00e4-4cac-822c-b1b8546b0179 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f3a228b0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:54.679613 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-dc2354fb-31d7-4370-a3ec-f39a82fb41d7 tempest-VolumesTestJSON-1046830247 tempest-VolumesTestJSON-1046830247-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.211605 Jun 28 03:17:54.680810 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 20/38] 10.222.0.44 () {58 vars in 1154 bytes} [Tue Jun 28 03:17:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:17:54.844663 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-bfffde91-00e4-4cac-822c-b1b8546b0179 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b" status: 200 len: 344 microversion: 2.1 time: 0.193608 Jun 28 03:17:54.845682 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 19/39] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:54 2022] GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b => generated 344 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:17:55.871211 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-5665f7e5-3ed0-4d03-83d5-e2816a560332 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f313e3a0>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:55.943259 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-5665f7e5-3ed0-4d03-83d5-e2816a560332 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] HTTP exception thrown: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-5665f7e5-3ed0-4d03-83d5-e2816a560332 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Request method failure captured: Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b HTTP/1.1 Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLUXXGnl0z5K17WCgEjmTcNtcd_LBr4gXxajC7UPbSGh38Y2FvROl5aQtZ1jMsVVzmhg6gKv83WbxQceNscOcVBfn5WpgfOtecePC_7joJb81VAOqvwsmPx9DVDCgZgF7cu7vfy5A0QjzaMYidWGJdOtKkzdfPhFYOZAFglB5xZWtM Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 88d296a918584c77b39af3c24655eeaf Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1069532400 Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:17:55.953331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:17:55.954483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_88d296a918584c77b39af3c24655eeaf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/88d296a918584c77b39af3c24655eeaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/88d296a918584c77b39af3c24655eeaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/88d296a918584c77b39af3c24655eeaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:17:55.954483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1069532400 Jun 28 03:17:55.954483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 88d296a918584c77b39af3c24655eeaf Jun 28 03:17:55.954483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1069532400 Jun 28 03:17:55.954483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-VolumesSnapshotsTestJSON-1069532400-project Jun 28 03:17:55.954483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:17:55.954483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:17:55.954483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4c80f79ae89c42c69ac124966a46c73a Jun 28 03:17:55.954483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1069532400-project Jun 28 03:17:55.954483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: Jun 28 03:17:55.954483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:55.954483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '543d5358-ad6c-4d13-bc48-2a6e42ae555b'} Jun 28 03:17:55.954483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. (HTTP 404) (Request-ID: req-a76314b9-74ac-4a07-a282-f2cdf587ef5f) Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:55.955190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 03:17:55.956082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 28 03:17:55.957074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:17:55.957968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:55.957968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:55.957968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:55.957968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:55.957968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:55.957968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:17:55.957968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:17:55.957968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:17:55.957968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:17:55.957968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:55.957968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:55.960735 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-5665f7e5-3ed0-4d03-83d5-e2816a560332 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Returning 404 to user: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:17:55.965963 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-5665f7e5-3ed0-4d03-83d5-e2816a560332 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b" status: 404 len: 109 microversion: 2.1 time: 0.111710 Jun 28 03:17:55.969218 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 21/40] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:55 2022] GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:17:55.995265 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-58a8b553-8000-457e-a2e9-8d4f3888c7e0 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f313ef70>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:56.118331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-58a8b553-8000-457e-a2e9-8d4f3888c7e0 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] HTTP exception thrown: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-58a8b553-8000-457e-a2e9-8d4f3888c7e0 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Request method failure captured: Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: DELETE /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b HTTP/1.1 Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLUXXGnl0z5K17WCgEjmTcNtcd_LBr4gXxajC7UPbSGh38Y2FvROl5aQtZ1jMsVVzmhg6gKv83WbxQceNscOcVBfn5WpgfOtecePC_7joJb81VAOqvwsmPx9DVDCgZgF7cu7vfy5A0QjzaMYidWGJdOtKkzdfPhFYOZAFglB5xZWtM Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 88d296a918584c77b39af3c24655eeaf Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1069532400 Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:17:56.121562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:17:56.122607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_88d296a918584c77b39af3c24655eeaf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/88d296a918584c77b39af3c24655eeaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/88d296a918584c77b39af3c24655eeaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/88d296a918584c77b39af3c24655eeaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:17:56.122607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1069532400 Jun 28 03:17:56.122607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 88d296a918584c77b39af3c24655eeaf Jun 28 03:17:56.122607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1069532400 Jun 28 03:17:56.122607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-VolumesSnapshotsTestJSON-1069532400-project Jun 28 03:17:56.122607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:17:56.122607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:17:56.122607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4c80f79ae89c42c69ac124966a46c73a Jun 28 03:17:56.122607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1069532400-project Jun 28 03:17:56.122607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: Jun 28 03:17:56.122607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:56.122607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '543d5358-ad6c-4d13-bc48-2a6e42ae555b'} Jun 28 03:17:56.122607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. (HTTP 404) (Request-ID: req-7abc2d1b-d926-46c9-a0db-8c1a8e20300b) Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:56.123213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 03:17:56.124125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 28 03:17:56.125472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:17:56.126346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:56.126346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.126346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:56.126346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.126346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:56.126346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:17:56.126346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:17:56.126346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:17:56.126346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:17:56.126346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:56.126346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.126346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-58a8b553-8000-457e-a2e9-8d4f3888c7e0 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Returning 404 to user: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:17:56.126346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-58a8b553-8000-457e-a2e9-8d4f3888c7e0 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b" status: 404 len: 109 microversion: 2.1 time: 0.142177 Jun 28 03:17:56.127813 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 22/41] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 28 03:17:55 2022] DELETE /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:17:56.132858 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f1a81ad3-1092-4320-aeb1-9fc4542c0f09 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Calling method '.version_select at 0x7f53f30ab3a0>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:17:56.238543 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-f1a81ad3-1092-4320-aeb1-9fc4542c0f09 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] HTTP exception thrown: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f1a81ad3-1092-4320-aeb1-9fc4542c0f09 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Request method failure captured: Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b HTTP/1.1 Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLUXXGnl0z5K17WCgEjmTcNtcd_LBr4gXxajC7UPbSGh38Y2FvROl5aQtZ1jMsVVzmhg6gKv83WbxQceNscOcVBfn5WpgfOtecePC_7joJb81VAOqvwsmPx9DVDCgZgF7cu7vfy5A0QjzaMYidWGJdOtKkzdfPhFYOZAFglB5xZWtM Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 88d296a918584c77b39af3c24655eeaf Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1069532400 Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:17:56.241481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:17:56.242535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_88d296a918584c77b39af3c24655eeaf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/88d296a918584c77b39af3c24655eeaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/88d296a918584c77b39af3c24655eeaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/88d296a918584c77b39af3c24655eeaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:17:56.242535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1069532400 Jun 28 03:17:56.242535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 88d296a918584c77b39af3c24655eeaf Jun 28 03:17:56.242535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1069532400 Jun 28 03:17:56.242535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-VolumesSnapshotsTestJSON-1069532400-project Jun 28 03:17:56.242535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:17:56.242535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:17:56.242535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4c80f79ae89c42c69ac124966a46c73a Jun 28 03:17:56.242535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1069532400-project Jun 28 03:17:56.242535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: Jun 28 03:17:56.242535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:56.242535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '543d5358-ad6c-4d13-bc48-2a6e42ae555b'} Jun 28 03:17:56.242535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. (HTTP 404) (Request-ID: req-308389f0-69de-4ff0-b63c-435ff2352912) Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:56.243199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 03:17:56.244343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 28 03:17:56.245233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:17:56.246228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:56.246228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.246228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:17:56.246228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.246228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:17:56.246228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:17:56.246228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:17:56.246228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:17:56.246228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:17:56.246228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. Jun 28 03:17:56.246228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:17:56.246228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f1a81ad3-1092-4320-aeb1-9fc4542c0f09 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] Returning 404 to user: Volume 543d5358-ad6c-4d13-bc48-2a6e42ae555b could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:17:56.246228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f1a81ad3-1092-4320-aeb1-9fc4542c0f09 tempest-VolumesSnapshotsTestJSON-1069532400 tempest-VolumesSnapshotsTestJSON-1069532400-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b" status: 404 len: 109 microversion: 2.1 time: 0.114129 Jun 28 03:17:56.252189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 23/42] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:17:56 2022] GET /compute/v2.1/os-volumes/543d5358-ad6c-4d13-bc48-2a6e42ae555b => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:17:56.291672 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-681923413", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "networks": [{"uuid": "ac13b420-c939-45ed-9039-496df8fc15f5"}]}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:17:56.628946 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] validate_networks() for [('ac13b420-c939-45ed-9039-496df8fc15f5', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:17:57.604242 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1932329575", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91e0cac6-eac1-4a49-93d7-95195e9565b8"}], "security_groups": [{"name": "tempest-securitygroup--1998108624"}], "key_name": "tempest-keypair-728925176", "user_data": "}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:17:58.421718 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.network.neutron [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] validate_networks() for [('91e0cac6-eac1-4a49-93d7-95195e9565b8', None, None, None, None, None)] {{(pid=117681) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:17:59.851105 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:17:59.851625 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:17:59.851963 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:17:59.852532 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:17:59.853482 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:17:59.885818 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:17:59.887713 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:17:59.897115 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:17:59.898626 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:17:59.998860 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Getting quotas for project 43bb7fc15b254d9f877373131c37923c. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:18:00.017202 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Getting quotas for user 4ee1c7fa1b03406bb4ff6395ca977aad and project 43bb7fc15b254d9f877373131c37923c. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:18:00.049645 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:18:00.055565 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:18:00.340601 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f6781fe2-f6e9-44e8-bc76-bd7b8e942a9c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.440136 Jun 28 03:18:00.342618 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 20/43] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:17:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 4446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 28 03:18:00.363001 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cdd4f8dc-ed9a-47e9-8d36-cf76e8ff04aa tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:00.363534 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cdd4f8dc-ed9a-47e9-8d36-cf76e8ff04aa tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:00.659218 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cdd4f8dc-ed9a-47e9-8d36-cf76e8ff04aa tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:00.711917 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cdd4f8dc-ed9a-47e9-8d36-cf76e8ff04aa tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1214 microversion: 2.1 time: 0.357403 Jun 28 03:18:00.713810 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 21/44] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:00 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1214 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:01.744326 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-818ba429-203b-44a2-b31e-25bf36182ebf tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:01.745490 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-818ba429-203b-44a2-b31e-25bf36182ebf tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:01.778343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=4 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:02.004818 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Flavor limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:18:02.005462 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Image limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:18:02.006090 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Flavor pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:18:02.006793 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Image pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:18:02.008700 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:18:02.027548 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:02.044345 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:02.045450 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:02.045883 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:02.100534 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-818ba429-203b-44a2-b31e-25bf36182ebf tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:02.102076 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Getting quotas for project 9e47b6f7a96c46dfa9906912efb7f265. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:18:02.112079 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Getting quotas for user 1f5f5b39c16f4cb38c12c33252786cc5 and project 9e47b6f7a96c46dfa9906912efb7f265. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:18:02.123899 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-818ba429-203b-44a2-b31e-25bf36182ebf tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1214 microversion: 2.1 time: 0.394597 Jun 28 03:18:02.129479 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 22/45] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:01 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1214 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:02.138474 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Going to run 1 instances... {{(pid=117681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:18:02.143849 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:18:02.305369 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7b8312ee-1857-4cd6-b0b4-f4e2d1a8597b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.706652 Jun 28 03:18:02.312247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 24/46] 10.222.0.44 () {62 vars in 1187 bytes} [Tue Jun 28 03:17:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 4714 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 28 03:18:02.318115 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c11e689e-ae41-4789-a234-840157b69aaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:02.318842 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c11e689e-ae41-4789-a234-840157b69aaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:02.483567 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c11e689e-ae41-4789-a234-840157b69aaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:02.495054 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c11e689e-ae41-4789-a234-840157b69aaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:02.498147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c11e689e-ae41-4789-a234-840157b69aaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:02.501394 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c11e689e-ae41-4789-a234-840157b69aaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1281 microversion: 2.20 time: 0.188236 Jun 28 03:18:02.506195 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:02 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:03.121996 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-470a8f91-1deb-4197-9620-5f823a5e4fb6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Action: 'create', calling method: .version_select at 0x7f53f30445e0>, body: {"keypair": {"name": "tempest-keypair-237055435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVyvjMJ++E+zngoyWHqLbLm47o+il0Z3HLG6jERUnpfWNRwYilRZO2UJeV00RDUjzz7VEvD1h2Ge6j6wO1OYhKEewx/wp0J+dh/yYItIsyJZuM/pTakwfRig/lo2ep+Bw=="}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:18:03.154178 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-81a8987f-9bfc-46d6-85ad-fea99726ad7f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:03.154679 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-81a8987f-9bfc-46d6-85ad-fea99726ad7f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:03.171481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-470a8f91-1deb-4197-9620-5f823a5e4fb6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for project 63f6b05085584fd5beecbe54c7251525. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:18:03.177514 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-470a8f91-1deb-4197-9620-5f823a5e4fb6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for user 4181737f6f2348d2906aea642b8598f7 and project 63f6b05085584fd5beecbe54c7251525. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:18:03.183160 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81a8987f-9bfc-46d6-85ad-fea99726ad7f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:03.184701 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81a8987f-9bfc-46d6-85ad-fea99726ad7f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:03.190501 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81a8987f-9bfc-46d6-85ad-fea99726ad7f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:03.192519 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81a8987f-9bfc-46d6-85ad-fea99726ad7f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:03.241366 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-470a8f91-1deb-4197-9620-5f823a5e4fb6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.721122 Jun 28 03:18:03.248911 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 25/48] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 28 03:18:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:18:03.531370 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4e33ab2a-859a-4c92-bf59-a7933cea6bcc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:03.531882 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4e33ab2a-859a-4c92-bf59-a7933cea6bcc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:03.583394 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-81a8987f-9bfc-46d6-85ad-fea99726ad7f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:03.616393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-81a8987f-9bfc-46d6-85ad-fea99726ad7f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1266 microversion: 2.1 time: 0.464916 Jun 28 03:18:03.626889 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 24/49] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:03 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1266 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:18:03.661479 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4e33ab2a-859a-4c92-bf59-a7933cea6bcc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:03.684304 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4e33ab2a-859a-4c92-bf59-a7933cea6bcc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:03.709533 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4e33ab2a-859a-4c92-bf59-a7933cea6bcc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:03.710724 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4e33ab2a-859a-4c92-bf59-a7933cea6bcc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1281 microversion: 2.20 time: 0.183517 Jun 28 03:18:03.711897 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:03 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1281 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:18:04.633853 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e795a838-4641-4ef6-9d08-aeae6218bd16 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:04.634584 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e795a838-4641-4ef6-9d08-aeae6218bd16 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:04.647838 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e795a838-4641-4ef6-9d08-aeae6218bd16 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:04.653205 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e795a838-4641-4ef6-9d08-aeae6218bd16 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:04.654167 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e795a838-4641-4ef6-9d08-aeae6218bd16 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:04.654621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e795a838-4641-4ef6-9d08-aeae6218bd16 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:04.733330 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-603af715-38e7-47c8-ae3e-abc9aaff9b77 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:04.736502 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-603af715-38e7-47c8-ae3e-abc9aaff9b77 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:04.759756 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-603af715-38e7-47c8-ae3e-abc9aaff9b77 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:04.760248 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-603af715-38e7-47c8-ae3e-abc9aaff9b77 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:04.761036 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-603af715-38e7-47c8-ae3e-abc9aaff9b77 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:04.761456 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-603af715-38e7-47c8-ae3e-abc9aaff9b77 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:04.874116 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e795a838-4641-4ef6-9d08-aeae6218bd16 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:04.888506 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e795a838-4641-4ef6-9d08-aeae6218bd16 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1272 microversion: 2.1 time: 0.258501 Jun 28 03:18:04.889088 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 25/51] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:04 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1272 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:05.069166 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-603af715-38e7-47c8-ae3e-abc9aaff9b77 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:05.089541 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-603af715-38e7-47c8-ae3e-abc9aaff9b77 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:05.092903 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-603af715-38e7-47c8-ae3e-abc9aaff9b77 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:05.094573 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-603af715-38e7-47c8-ae3e-abc9aaff9b77 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1333 microversion: 2.20 time: 0.369306 Jun 28 03:18:05.104260 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:04 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1333 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:05.912826 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fa00cf36-3ab4-4085-a67c-79f7eb87995e tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:05.914196 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fa00cf36-3ab4-4085-a67c-79f7eb87995e tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:05.922701 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa00cf36-3ab4-4085-a67c-79f7eb87995e tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:05.926134 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa00cf36-3ab4-4085-a67c-79f7eb87995e tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:05.940267 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa00cf36-3ab4-4085-a67c-79f7eb87995e tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:05.940927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa00cf36-3ab4-4085-a67c-79f7eb87995e tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:06.122075 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-52e3ab88-94da-456a-a3d7-099ba4e6defe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:06.122776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-52e3ab88-94da-456a-a3d7-099ba4e6defe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:06.138923 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-52e3ab88-94da-456a-a3d7-099ba4e6defe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:06.139159 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-52e3ab88-94da-456a-a3d7-099ba4e6defe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:06.139946 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-52e3ab88-94da-456a-a3d7-099ba4e6defe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:06.140459 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-52e3ab88-94da-456a-a3d7-099ba4e6defe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:06.322980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fa00cf36-3ab4-4085-a67c-79f7eb87995e tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:06.354744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fa00cf36-3ab4-4085-a67c-79f7eb87995e tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1272 microversion: 2.1 time: 0.448309 Jun 28 03:18:06.359752 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 26/53] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:05 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1272 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:06.442161 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-52e3ab88-94da-456a-a3d7-099ba4e6defe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:06.452836 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-52e3ab88-94da-456a-a3d7-099ba4e6defe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:06.460849 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-52e3ab88-94da-456a-a3d7-099ba4e6defe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:06.470772 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-52e3ab88-94da-456a-a3d7-099ba4e6defe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1339 microversion: 2.20 time: 0.349633 Jun 28 03:18:06.473618 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 28/54] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:06 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1339 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:06.908533 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1963827407", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78d460e7-819f-442d-8ddd-fecab5b4b6fc"}], "security_groups": [{"name": "tempest-securitygroup--874474014"}], "key_name": "tempest-keypair-237055435", "user_data": "}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:18:07.375845 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c929754c-1b7e-4462-8c76-262b7816983c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:07.377237 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c929754c-1b7e-4462-8c76-262b7816983c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:07.384005 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c929754c-1b7e-4462-8c76-262b7816983c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:07.384944 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c929754c-1b7e-4462-8c76-262b7816983c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:07.385252 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c929754c-1b7e-4462-8c76-262b7816983c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:07.385690 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c929754c-1b7e-4462-8c76-262b7816983c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:07.886440 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] validate_networks() for [('78d460e7-819f-442d-8ddd-fecab5b4b6fc', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:18:08.886917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c929754c-1b7e-4462-8c76-262b7816983c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:08.902881 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c929754c-1b7e-4462-8c76-262b7816983c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 1.530948 Jun 28 03:18:08.903964 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 29/55] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:07 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:08.934834 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-edf6e944-d03f-40e2-9201-79e139e388c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:08.935589 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-edf6e944-d03f-40e2-9201-79e139e388c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:08.959693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-edf6e944-d03f-40e2-9201-79e139e388c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:08.969065 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-edf6e944-d03f-40e2-9201-79e139e388c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:08.970096 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-edf6e944-d03f-40e2-9201-79e139e388c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:08.970682 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-edf6e944-d03f-40e2-9201-79e139e388c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:09.149229 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-edf6e944-d03f-40e2-9201-79e139e388c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:09.164280 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-edf6e944-d03f-40e2-9201-79e139e388c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:09.167865 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-edf6e944-d03f-40e2-9201-79e139e388c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:09.174238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-edf6e944-d03f-40e2-9201-79e139e388c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1339 microversion: 2.20 time: 0.261669 Jun 28 03:18:09.175913 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 30/56] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:08 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1339 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:09.929442 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-fe447c20-1a4e-4094-814a-1c8129b7c41f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:09.931789 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-fe447c20-1a4e-4094-814a-1c8129b7c41f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:09.946654 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fe447c20-1a4e-4094-814a-1c8129b7c41f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:09.948002 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fe447c20-1a4e-4094-814a-1c8129b7c41f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:09.950945 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fe447c20-1a4e-4094-814a-1c8129b7c41f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:09.952791 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fe447c20-1a4e-4094-814a-1c8129b7c41f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:09.953781 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:10.917022 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-fe447c20-1a4e-4094-814a-1c8129b7c41f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:10.940473 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-fe447c20-1a4e-4094-814a-1c8129b7c41f tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 1.003885 Jun 28 03:18:10.950172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 31/57] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:09 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:10.950172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c2f63a84-e2fe-48cc-a640-83fd1069e1ce tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:10.950172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c2f63a84-e2fe-48cc-a640-83fd1069e1ce tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:10.962519 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c2f63a84-e2fe-48cc-a640-83fd1069e1ce tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:10.963046 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c2f63a84-e2fe-48cc-a640-83fd1069e1ce tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:10.964058 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c2f63a84-e2fe-48cc-a640-83fd1069e1ce tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:10.964659 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c2f63a84-e2fe-48cc-a640-83fd1069e1ce tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:11.147182 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:18:11.147681 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:18:11.148093 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:18:11.149007 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:18:11.149515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:18:11.177861 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:11.182049 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:11.190394 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:11.190845 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:11.277984 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for project 63f6b05085584fd5beecbe54c7251525. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:18:11.291984 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for user 4181737f6f2348d2906aea642b8598f7 and project 63f6b05085584fd5beecbe54c7251525. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:18:11.348393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:18:11.353688 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:18:11.476775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6abcfe9f-974e-440b-8f31-357c4b83b9f4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.574811 Jun 28 03:18:11.480796 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 27/58] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:18:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 4580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:18:11.499755 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f0ea616a-a8fd-4895-8261-dd6ce79ca60e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:11.501988 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f0ea616a-a8fd-4895-8261-dd6ce79ca60e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:11.641451 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c2f63a84-e2fe-48cc-a640-83fd1069e1ce tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:11.668907 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c2f63a84-e2fe-48cc-a640-83fd1069e1ce tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:11.682402 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c2f63a84-e2fe-48cc-a640-83fd1069e1ce tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:11.689119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c2f63a84-e2fe-48cc-a640-83fd1069e1ce tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.742147 Jun 28 03:18:11.690202 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 32/59] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:10 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:11.770361 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f0ea616a-a8fd-4895-8261-dd6ce79ca60e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:11.781139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f0ea616a-a8fd-4895-8261-dd6ce79ca60e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1241 microversion: 2.1 time: 0.293550 Jun 28 03:18:11.782838 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 28/60] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:11 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1241 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:11.957226 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a8a35ce3-b00f-4179-b55f-879775a6c4bc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:11.957990 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a8a35ce3-b00f-4179-b55f-879775a6c4bc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:11.972659 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a8a35ce3-b00f-4179-b55f-879775a6c4bc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:11.982594 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a8a35ce3-b00f-4179-b55f-879775a6c4bc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:11.986022 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a8a35ce3-b00f-4179-b55f-879775a6c4bc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:11.992715 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a8a35ce3-b00f-4179-b55f-879775a6c4bc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:12.076723 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:12.259401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-ae06b08a-c5fb-4248-a544-1578c3d012d9 req-dde924d3-efc0-4888-86ea-4733c2f8bce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf28320-d40d-457d-8b03-3157d65b8a18", "tag": "06f883b9-139a-473c-971e-de82ca62f9ab"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:18:12.305814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-ae06b08a-c5fb-4248-a544-1578c3d012d9 req-dde924d3-efc0-4888-86ea-4733c2f8bce0 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:12.306360 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-ae06b08a-c5fb-4248-a544-1578c3d012d9 req-dde924d3-efc0-4888-86ea-4733c2f8bce0 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:12.414231 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-ae06b08a-c5fb-4248-a544-1578c3d012d9 req-dde924d3-efc0-4888-86ea-4733c2f8bce0 service nova] Creating event network-changed:06f883b9-139a-473c-971e-de82ca62f9ab for instance bcf28320-d40d-457d-8b03-3157d65b8a18 on hv-cinder-84684 Jun 28 03:18:12.418218 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-ae06b08a-c5fb-4248-a544-1578c3d012d9 req-dde924d3-efc0-4888-86ea-4733c2f8bce0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 28 03:18:12.430453 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2ee78347-a14b-44f4-bc36-7aee8f93a786 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:12.431400 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2ee78347-a14b-44f4-bc36-7aee8f93a786 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:12.438157 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2ee78347-a14b-44f4-bc36-7aee8f93a786 None None] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:12.441703 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2ee78347-a14b-44f4-bc36-7aee8f93a786 None None] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:12.491981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.compute.rpcapi [None req-2ee78347-a14b-44f4-bc36-7aee8f93a786 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 28 03:18:12.495993 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2ee78347-a14b-44f4-bc36-7aee8f93a786 None None] Releasing lock "compute-rpcapi-router" {{(pid=117681) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 28 03:18:12.558246 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2ee78347-a14b-44f4-bc36-7aee8f93a786 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.865908 Jun 28 03:18:12.559330 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 33/61] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:18:12.708804 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a0c585ec-a8ec-4b97-b5cc-8ea762a6a493 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:12.709555 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a0c585ec-a8ec-4b97-b5cc-8ea762a6a493 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:12.727384 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a0c585ec-a8ec-4b97-b5cc-8ea762a6a493 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:12.728243 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a0c585ec-a8ec-4b97-b5cc-8ea762a6a493 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:12.729030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a0c585ec-a8ec-4b97-b5cc-8ea762a6a493 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:12.729743 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a0c585ec-a8ec-4b97-b5cc-8ea762a6a493 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:13.045108 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a8a35ce3-b00f-4179-b55f-879775a6c4bc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:13.056619 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a8a35ce3-b00f-4179-b55f-879775a6c4bc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 1.103675 Jun 28 03:18:13.057243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 29/62] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:11 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:13.072133 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4e85947b-5475-4998-841a-2189d56106b6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:13.079188 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4e85947b-5475-4998-841a-2189d56106b6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:13.099815 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e85947b-5475-4998-841a-2189d56106b6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:13.100549 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e85947b-5475-4998-841a-2189d56106b6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:13.101552 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e85947b-5475-4998-841a-2189d56106b6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:13.102208 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e85947b-5475-4998-841a-2189d56106b6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:13.347894 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4e85947b-5475-4998-841a-2189d56106b6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:13.363213 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4e85947b-5475-4998-841a-2189d56106b6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1245 microversion: 2.1 time: 0.299313 Jun 28 03:18:13.367464 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 30/63] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:13 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1245 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:13.536279 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a0c585ec-a8ec-4b97-b5cc-8ea762a6a493 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:13.562036 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a0c585ec-a8ec-4b97-b5cc-8ea762a6a493 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:13.570237 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a0c585ec-a8ec-4b97-b5cc-8ea762a6a493 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:13.572870 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a0c585ec-a8ec-4b97-b5cc-8ea762a6a493 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.869097 Jun 28 03:18:13.575453 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 34/64] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:12 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:14.074939 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-927bcd5c-0f82-406a-83fb-0d0ba8719273 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:14.075548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-927bcd5c-0f82-406a-83fb-0d0ba8719273 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:14.088841 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-927bcd5c-0f82-406a-83fb-0d0ba8719273 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:14.091351 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-927bcd5c-0f82-406a-83fb-0d0ba8719273 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:14.096533 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-927bcd5c-0f82-406a-83fb-0d0ba8719273 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:14.097251 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-927bcd5c-0f82-406a-83fb-0d0ba8719273 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:14.347298 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-927bcd5c-0f82-406a-83fb-0d0ba8719273 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:14.357988 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-927bcd5c-0f82-406a-83fb-0d0ba8719273 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.287315 Jun 28 03:18:14.362689 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 31/65] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:14 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:14.381409 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-be96cace-697b-41b6-9c48-ef90618e8fe5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:14.382292 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-be96cace-697b-41b6-9c48-ef90618e8fe5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:14.384586 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=12 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:14.390792 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-be96cace-697b-41b6-9c48-ef90618e8fe5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:14.391551 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-be96cace-697b-41b6-9c48-ef90618e8fe5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:14.392807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-be96cace-697b-41b6-9c48-ef90618e8fe5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:14.393376 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-be96cace-697b-41b6-9c48-ef90618e8fe5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:14.481560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-be96cace-697b-41b6-9c48-ef90618e8fe5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:14.490388 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-be96cace-697b-41b6-9c48-ef90618e8fe5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1293 microversion: 2.1 time: 0.112841 Jun 28 03:18:14.501696 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 35/66] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:14 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1293 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:14.593217 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6e53aa6e-8efa-4090-8a66-fbaba0ea6928 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:14.593816 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6e53aa6e-8efa-4090-8a66-fbaba0ea6928 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:14.600179 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e53aa6e-8efa-4090-8a66-fbaba0ea6928 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:14.600783 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e53aa6e-8efa-4090-8a66-fbaba0ea6928 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:14.601814 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e53aa6e-8efa-4090-8a66-fbaba0ea6928 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:14.602560 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e53aa6e-8efa-4090-8a66-fbaba0ea6928 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:14.742123 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6e53aa6e-8efa-4090-8a66-fbaba0ea6928 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:14.753092 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6e53aa6e-8efa-4090-8a66-fbaba0ea6928 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:14.754912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6e53aa6e-8efa-4090-8a66-fbaba0ea6928 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:14.756315 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6e53aa6e-8efa-4090-8a66-fbaba0ea6928 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.167109 Jun 28 03:18:14.770005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 32/67] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:14 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:18:14.957260 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-06b92a87-8cea-4889-9735-36b43df573ec req-7bab7ea6-7e80-4a80-af3d-6ded517b96a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f3fd86-9d6c-4d2e-8997-579c77adc3f0", "tag": "9e28a86b-c03c-4271-880f-a8d72e9df423"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:18:14.966437 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-06b92a87-8cea-4889-9735-36b43df573ec req-7bab7ea6-7e80-4a80-af3d-6ded517b96a2 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:14.967292 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-06b92a87-8cea-4889-9735-36b43df573ec req-7bab7ea6-7e80-4a80-af3d-6ded517b96a2 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:14.978551 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-06b92a87-8cea-4889-9735-36b43df573ec req-7bab7ea6-7e80-4a80-af3d-6ded517b96a2 service nova] Creating event network-changed:9e28a86b-c03c-4271-880f-a8d72e9df423 for instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 on hv-cinder-84684 Jun 28 03:18:14.984094 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-06b92a87-8cea-4889-9735-36b43df573ec req-7bab7ea6-7e80-4a80-af3d-6ded517b96a2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214995 Jun 28 03:18:14.984944 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 36/68] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:18:15.381512 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c1f09b19-6808-4e0b-b9d3-4f65024b2e6c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:15.381970 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c1f09b19-6808-4e0b-b9d3-4f65024b2e6c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:15.388451 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c1f09b19-6808-4e0b-b9d3-4f65024b2e6c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:15.388991 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c1f09b19-6808-4e0b-b9d3-4f65024b2e6c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:15.389780 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c1f09b19-6808-4e0b-b9d3-4f65024b2e6c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:15.390269 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c1f09b19-6808-4e0b-b9d3-4f65024b2e6c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:15.509078 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6e9d5ac8-6eb8-4072-bb88-3995508a2d2b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:15.509869 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6e9d5ac8-6eb8-4072-bb88-3995508a2d2b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:15.516717 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6e9d5ac8-6eb8-4072-bb88-3995508a2d2b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:15.517166 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6e9d5ac8-6eb8-4072-bb88-3995508a2d2b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:15.517935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6e9d5ac8-6eb8-4072-bb88-3995508a2d2b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:15.518371 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6e9d5ac8-6eb8-4072-bb88-3995508a2d2b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:15.548336 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c1f09b19-6808-4e0b-b9d3-4f65024b2e6c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:15.555842 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c1f09b19-6808-4e0b-b9d3-4f65024b2e6c tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.178843 Jun 28 03:18:15.556853 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 33/69] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:15 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:15.591143 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6e9d5ac8-6eb8-4072-bb88-3995508a2d2b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:15.598710 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6e9d5ac8-6eb8-4072-bb88-3995508a2d2b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1293 microversion: 2.1 time: 0.094255 Jun 28 03:18:15.602255 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 37/70] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:15 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:15.774399 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3c139d23-d0f5-4757-9691-cc2760f4c3fa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:15.775034 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3c139d23-d0f5-4757-9691-cc2760f4c3fa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:15.781307 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c139d23-d0f5-4757-9691-cc2760f4c3fa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:15.781747 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c139d23-d0f5-4757-9691-cc2760f4c3fa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:15.782504 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c139d23-d0f5-4757-9691-cc2760f4c3fa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:15.782935 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c139d23-d0f5-4757-9691-cc2760f4c3fa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:15.916128 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3c139d23-d0f5-4757-9691-cc2760f4c3fa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:15.924487 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3c139d23-d0f5-4757-9691-cc2760f4c3fa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:15.926038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3c139d23-d0f5-4757-9691-cc2760f4c3fa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:15.927210 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3c139d23-d0f5-4757-9691-cc2760f4c3fa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.156958 Jun 28 03:18:15.928126 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 34/71] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:15 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:16.574848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-58d2ab69-899c-4332-876f-5532a56352ad tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:16.575542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-58d2ab69-899c-4332-876f-5532a56352ad tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:16.584578 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-58d2ab69-899c-4332-876f-5532a56352ad tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:16.587594 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-58d2ab69-899c-4332-876f-5532a56352ad tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:16.589001 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-58d2ab69-899c-4332-876f-5532a56352ad tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:16.590147 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-58d2ab69-899c-4332-876f-5532a56352ad tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:16.622471 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5e43e286-dc0b-48dd-b668-acd1f790b4b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:16.623601 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5e43e286-dc0b-48dd-b668-acd1f790b4b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:16.637037 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5e43e286-dc0b-48dd-b668-acd1f790b4b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:16.637700 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5e43e286-dc0b-48dd-b668-acd1f790b4b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:16.646299 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5e43e286-dc0b-48dd-b668-acd1f790b4b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:16.647387 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5e43e286-dc0b-48dd-b668-acd1f790b4b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:16.773546 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5e43e286-dc0b-48dd-b668-acd1f790b4b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:16.787704 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5e43e286-dc0b-48dd-b668-acd1f790b4b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1293 microversion: 2.1 time: 0.171973 Jun 28 03:18:16.791197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 35/72] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:16 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1293 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:16.827743 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-58d2ab69-899c-4332-876f-5532a56352ad tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:16.837323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-58d2ab69-899c-4332-876f-5532a56352ad tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.267867 Jun 28 03:18:16.838408 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 38/73] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:16 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:16.949199 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-82782d76-710d-4862-81f6-45494a28b6ba tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:16.950452 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-82782d76-710d-4862-81f6-45494a28b6ba tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:16.957691 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82782d76-710d-4862-81f6-45494a28b6ba tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:16.958647 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82782d76-710d-4862-81f6-45494a28b6ba tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:16.959573 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82782d76-710d-4862-81f6-45494a28b6ba tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:16.960640 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82782d76-710d-4862-81f6-45494a28b6ba tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:17.169401 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-82782d76-710d-4862-81f6-45494a28b6ba tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:17.187254 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-82782d76-710d-4862-81f6-45494a28b6ba tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:17.189609 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-82782d76-710d-4862-81f6-45494a28b6ba tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:17.195807 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-82782d76-710d-4862-81f6-45494a28b6ba tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.252409 Jun 28 03:18:17.197105 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 36/74] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:16 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:18:17.807740 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3c5633ab-1cb0-43b8-a252-e1c423c3f69b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:17.809019 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-3c5633ab-1cb0-43b8-a252-e1c423c3f69b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:17.816088 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3c5633ab-1cb0-43b8-a252-e1c423c3f69b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:17.816828 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3c5633ab-1cb0-43b8-a252-e1c423c3f69b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:17.817767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3c5633ab-1cb0-43b8-a252-e1c423c3f69b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:17.818365 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3c5633ab-1cb0-43b8-a252-e1c423c3f69b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:17.854920 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e023f9ac-66cc-447d-8313-8aaeb272c434 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:17.856440 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e023f9ac-66cc-447d-8313-8aaeb272c434 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:17.881723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e023f9ac-66cc-447d-8313-8aaeb272c434 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:17.882655 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e023f9ac-66cc-447d-8313-8aaeb272c434 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:17.883827 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e023f9ac-66cc-447d-8313-8aaeb272c434 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:17.885564 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e023f9ac-66cc-447d-8313-8aaeb272c434 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:17.905844 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-3c5633ab-1cb0-43b8-a252-e1c423c3f69b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:17.914524 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3c5633ab-1cb0-43b8-a252-e1c423c3f69b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1293 microversion: 2.1 time: 0.110797 Jun 28 03:18:17.924347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 39/75] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:17 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:18.120316 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e023f9ac-66cc-447d-8313-8aaeb272c434 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:18.149553 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e023f9ac-66cc-447d-8313-8aaeb272c434 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.298387 Jun 28 03:18:18.153430 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 37/76] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:17 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:18.215197 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f7c500af-a8ee-4b13-9509-50909e96dc8e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:18.215909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f7c500af-a8ee-4b13-9509-50909e96dc8e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:18.229982 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f7c500af-a8ee-4b13-9509-50909e96dc8e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:18.230730 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f7c500af-a8ee-4b13-9509-50909e96dc8e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:18.231803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f7c500af-a8ee-4b13-9509-50909e96dc8e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:18.232558 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f7c500af-a8ee-4b13-9509-50909e96dc8e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:18.385723 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-f7c500af-a8ee-4b13-9509-50909e96dc8e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:18.414590 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-f7c500af-a8ee-4b13-9509-50909e96dc8e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:18.416515 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-f7c500af-a8ee-4b13-9509-50909e96dc8e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:18.417847 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f7c500af-a8ee-4b13-9509-50909e96dc8e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.207004 Jun 28 03:18:18.419425 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 40/77] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:18 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:18.931228 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-20e2a7b5-0033-4b82-9a1e-4997f42e8331 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:18.931830 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-20e2a7b5-0033-4b82-9a1e-4997f42e8331 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:18.938739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20e2a7b5-0033-4b82-9a1e-4997f42e8331 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:18.939526 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20e2a7b5-0033-4b82-9a1e-4997f42e8331 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:18.940562 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20e2a7b5-0033-4b82-9a1e-4997f42e8331 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:18.941140 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20e2a7b5-0033-4b82-9a1e-4997f42e8331 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:19.022547 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-20e2a7b5-0033-4b82-9a1e-4997f42e8331 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:19.030015 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-20e2a7b5-0033-4b82-9a1e-4997f42e8331 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1293 microversion: 2.1 time: 0.102659 Jun 28 03:18:19.041308 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 38/78] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:18 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1293 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:19.175224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a1912c66-1fae-44b1-8c70-e935b4f5d6b8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:19.176464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a1912c66-1fae-44b1-8c70-e935b4f5d6b8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:19.185522 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a1912c66-1fae-44b1-8c70-e935b4f5d6b8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:19.186190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a1912c66-1fae-44b1-8c70-e935b4f5d6b8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:19.187546 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a1912c66-1fae-44b1-8c70-e935b4f5d6b8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:19.188174 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a1912c66-1fae-44b1-8c70-e935b4f5d6b8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:19.416460 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a1912c66-1fae-44b1-8c70-e935b4f5d6b8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:19.436033 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2192c1d0-d146-432e-88f1-347e04e35d64 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:19.436671 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2192c1d0-d146-432e-88f1-347e04e35d64 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:19.441787 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a1912c66-1fae-44b1-8c70-e935b4f5d6b8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.274567 Jun 28 03:18:19.442927 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 41/79] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:19 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:19.445519 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2192c1d0-d146-432e-88f1-347e04e35d64 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:19.447366 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2192c1d0-d146-432e-88f1-347e04e35d64 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:19.449479 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2192c1d0-d146-432e-88f1-347e04e35d64 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:19.455640 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2192c1d0-d146-432e-88f1-347e04e35d64 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:19.679580 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2192c1d0-d146-432e-88f1-347e04e35d64 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:19.687778 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2192c1d0-d146-432e-88f1-347e04e35d64 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:19.689268 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2192c1d0-d146-432e-88f1-347e04e35d64 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:19.690366 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2192c1d0-d146-432e-88f1-347e04e35d64 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.258499 Jun 28 03:18:19.690925 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 39/80] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:19 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:20.047261 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-043d3645-8c4a-4c2e-81ef-98c6ac4467c9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:20.047867 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-043d3645-8c4a-4c2e-81ef-98c6ac4467c9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:20.054839 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-043d3645-8c4a-4c2e-81ef-98c6ac4467c9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:20.055400 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-043d3645-8c4a-4c2e-81ef-98c6ac4467c9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:20.056555 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-043d3645-8c4a-4c2e-81ef-98c6ac4467c9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:20.057040 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-043d3645-8c4a-4c2e-81ef-98c6ac4467c9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:20.126788 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-043d3645-8c4a-4c2e-81ef-98c6ac4467c9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:20.137390 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-043d3645-8c4a-4c2e-81ef-98c6ac4467c9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1293 microversion: 2.1 time: 0.093832 Jun 28 03:18:20.138107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 42/81] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:20 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:20.458795 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-533426ca-6550-4ccc-9680-d77d7d94df26 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:20.459516 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-533426ca-6550-4ccc-9680-d77d7d94df26 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:20.465819 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-533426ca-6550-4ccc-9680-d77d7d94df26 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:20.466366 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-533426ca-6550-4ccc-9680-d77d7d94df26 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:20.467194 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-533426ca-6550-4ccc-9680-d77d7d94df26 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:20.467694 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-533426ca-6550-4ccc-9680-d77d7d94df26 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:20.613539 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-533426ca-6550-4ccc-9680-d77d7d94df26 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:20.620963 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-533426ca-6550-4ccc-9680-d77d7d94df26 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.165970 Jun 28 03:18:20.621829 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 40/82] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:20 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:20.708508 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a63331e2-98bc-4529-9d2e-6d0738810e19 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:20.709197 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a63331e2-98bc-4529-9d2e-6d0738810e19 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:20.716762 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a63331e2-98bc-4529-9d2e-6d0738810e19 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:20.717358 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a63331e2-98bc-4529-9d2e-6d0738810e19 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:20.718356 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a63331e2-98bc-4529-9d2e-6d0738810e19 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:20.718878 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a63331e2-98bc-4529-9d2e-6d0738810e19 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:20.848458 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a63331e2-98bc-4529-9d2e-6d0738810e19 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:20.857827 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a63331e2-98bc-4529-9d2e-6d0738810e19 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:20.859289 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a63331e2-98bc-4529-9d2e-6d0738810e19 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:20.860738 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a63331e2-98bc-4529-9d2e-6d0738810e19 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.155768 Jun 28 03:18:20.861293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 43/83] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:20 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:21.154306 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f368e311-c579-45d1-9055-7c511384c742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:21.155051 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f368e311-c579-45d1-9055-7c511384c742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:21.161470 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f368e311-c579-45d1-9055-7c511384c742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:21.161922 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f368e311-c579-45d1-9055-7c511384c742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:21.162661 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f368e311-c579-45d1-9055-7c511384c742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:21.163090 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f368e311-c579-45d1-9055-7c511384c742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:21.228386 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f368e311-c579-45d1-9055-7c511384c742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:21.231789 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:21.236857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f368e311-c579-45d1-9055-7c511384c742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1293 microversion: 2.1 time: 0.086516 Jun 28 03:18:21.237419 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 41/84] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:21 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:21.638719 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-38bc3a17-3fd5-42e9-a332-eea42575cf21 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:21.638719 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-38bc3a17-3fd5-42e9-a332-eea42575cf21 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:21.641716 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=5 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:21.645727 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-38bc3a17-3fd5-42e9-a332-eea42575cf21 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:21.646196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-38bc3a17-3fd5-42e9-a332-eea42575cf21 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:21.646958 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-38bc3a17-3fd5-42e9-a332-eea42575cf21 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:21.647549 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-38bc3a17-3fd5-42e9-a332-eea42575cf21 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:21.653194 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=100 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:21.879512 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-af34bd0f-f0bd-4633-bf50-c40d90f53163 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:21.880413 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-af34bd0f-f0bd-4633-bf50-c40d90f53163 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:21.882417 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:21.883645 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=20 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:21.889606 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-af34bd0f-f0bd-4633-bf50-c40d90f53163 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:21.890622 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-af34bd0f-f0bd-4633-bf50-c40d90f53163 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:21.891476 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-af34bd0f-f0bd-4633-bf50-c40d90f53163 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:21.891971 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-af34bd0f-f0bd-4633-bf50-c40d90f53163 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:21.983741 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-38bc3a17-3fd5-42e9-a332-eea42575cf21 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:21.993064 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-38bc3a17-3fd5-42e9-a332-eea42575cf21 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.358813 Jun 28 03:18:21.994030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 44/85] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:21 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:22.085215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-af34bd0f-f0bd-4633-bf50-c40d90f53163 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:22.094195 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-af34bd0f-f0bd-4633-bf50-c40d90f53163 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:22.095739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-af34bd0f-f0bd-4633-bf50-c40d90f53163 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:22.096953 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-af34bd0f-f0bd-4633-bf50-c40d90f53163 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.221803 Jun 28 03:18:22.107645 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 42/86] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:21 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:22.253892 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-62bf9de0-9428-418f-a452-d58e994c205b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:22.254560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-62bf9de0-9428-418f-a452-d58e994c205b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:22.261005 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-62bf9de0-9428-418f-a452-d58e994c205b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:22.261438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-62bf9de0-9428-418f-a452-d58e994c205b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:22.262176 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-62bf9de0-9428-418f-a452-d58e994c205b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:22.262593 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-62bf9de0-9428-418f-a452-d58e994c205b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:22.323731 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-62bf9de0-9428-418f-a452-d58e994c205b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:22.331343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-62bf9de0-9428-418f-a452-d58e994c205b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1293 microversion: 2.1 time: 0.081367 Jun 28 03:18:22.331822 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 45/87] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:22 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:23.014340 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-44eff33d-3e2b-4a90-8b72-4437714d50f2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:23.014944 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-44eff33d-3e2b-4a90-8b72-4437714d50f2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:23.020096 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:23.022239 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44eff33d-3e2b-4a90-8b72-4437714d50f2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:23.022894 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44eff33d-3e2b-4a90-8b72-4437714d50f2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:23.023691 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44eff33d-3e2b-4a90-8b72-4437714d50f2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:23.024353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44eff33d-3e2b-4a90-8b72-4437714d50f2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:23.115750 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-069a4499-a030-4ed1-9a78-95efcac1a4a2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:23.116435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-069a4499-a030-4ed1-9a78-95efcac1a4a2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:23.118559 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:23.126427 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-069a4499-a030-4ed1-9a78-95efcac1a4a2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:23.126933 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-069a4499-a030-4ed1-9a78-95efcac1a4a2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:23.128679 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-069a4499-a030-4ed1-9a78-95efcac1a4a2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:23.129315 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-069a4499-a030-4ed1-9a78-95efcac1a4a2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:23.165177 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-44eff33d-3e2b-4a90-8b72-4437714d50f2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:23.174445 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-44eff33d-3e2b-4a90-8b72-4437714d50f2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.167894 Jun 28 03:18:23.175006 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 43/88] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:23 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:23.285749 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-069a4499-a030-4ed1-9a78-95efcac1a4a2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:23.294488 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-069a4499-a030-4ed1-9a78-95efcac1a4a2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:23.296066 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-069a4499-a030-4ed1-9a78-95efcac1a4a2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:23.297193 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-069a4499-a030-4ed1-9a78-95efcac1a4a2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.185760 Jun 28 03:18:23.297813 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 46/89] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:23 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:23.348847 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-aad33b80-f690-4ddd-b656-3c26c6e54e74 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:23.349449 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-aad33b80-f690-4ddd-b656-3c26c6e54e74 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:23.355717 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aad33b80-f690-4ddd-b656-3c26c6e54e74 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:23.356224 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aad33b80-f690-4ddd-b656-3c26c6e54e74 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:23.356988 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aad33b80-f690-4ddd-b656-3c26c6e54e74 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:23.357412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aad33b80-f690-4ddd-b656-3c26c6e54e74 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:23.426185 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-aad33b80-f690-4ddd-b656-3c26c6e54e74 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:23.433764 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-aad33b80-f690-4ddd-b656-3c26c6e54e74 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1293 microversion: 2.1 time: 0.088746 Jun 28 03:18:23.434370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 44/90] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:23 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:24.190903 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-19d8ec11-2d97-41fa-a13f-07016672e431 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:24.191605 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-19d8ec11-2d97-41fa-a13f-07016672e431 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:24.197978 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-19d8ec11-2d97-41fa-a13f-07016672e431 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:24.198414 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-19d8ec11-2d97-41fa-a13f-07016672e431 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:24.199202 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-19d8ec11-2d97-41fa-a13f-07016672e431 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:24.199629 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-19d8ec11-2d97-41fa-a13f-07016672e431 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:24.314857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f655a406-0996-4660-8318-7000c66a9436 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:24.315456 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f655a406-0996-4660-8318-7000c66a9436 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:24.321926 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f655a406-0996-4660-8318-7000c66a9436 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:24.322365 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f655a406-0996-4660-8318-7000c66a9436 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:24.323118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f655a406-0996-4660-8318-7000c66a9436 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:24.323538 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f655a406-0996-4660-8318-7000c66a9436 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:24.352609 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-19d8ec11-2d97-41fa-a13f-07016672e431 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:24.360761 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-19d8ec11-2d97-41fa-a13f-07016672e431 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.173355 Jun 28 03:18:24.361732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 47/91] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:24 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:24.449965 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7d991b42-eecc-4fd9-98b0-71ba98706c42 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:24.450809 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7d991b42-eecc-4fd9-98b0-71ba98706c42 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:24.458065 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7d991b42-eecc-4fd9-98b0-71ba98706c42 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:24.458509 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7d991b42-eecc-4fd9-98b0-71ba98706c42 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:24.459495 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7d991b42-eecc-4fd9-98b0-71ba98706c42 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:24.460080 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7d991b42-eecc-4fd9-98b0-71ba98706c42 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:24.461644 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f655a406-0996-4660-8318-7000c66a9436 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:24.470489 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f655a406-0996-4660-8318-7000c66a9436 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:24.472140 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f655a406-0996-4660-8318-7000c66a9436 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:24.473274 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f655a406-0996-4660-8318-7000c66a9436 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.162430 Jun 28 03:18:24.483078 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 45/92] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:24 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:18:24.529883 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7d991b42-eecc-4fd9-98b0-71ba98706c42 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:24.537768 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7d991b42-eecc-4fd9-98b0-71ba98706c42 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1293 microversion: 2.1 time: 0.091950 Jun 28 03:18:24.538652 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 48/93] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:24 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:18:25.378213 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c28547e9-a3c2-4115-889c-755dc4b59aff tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:25.378789 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c28547e9-a3c2-4115-889c-755dc4b59aff tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:25.385213 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c28547e9-a3c2-4115-889c-755dc4b59aff tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:25.385650 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c28547e9-a3c2-4115-889c-755dc4b59aff tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:25.386398 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c28547e9-a3c2-4115-889c-755dc4b59aff tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:25.386823 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c28547e9-a3c2-4115-889c-755dc4b59aff tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:25.492423 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ae721566-f4b2-4400-b5f0-91a83cfeda38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:25.493018 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ae721566-f4b2-4400-b5f0-91a83cfeda38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:25.499379 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ae721566-f4b2-4400-b5f0-91a83cfeda38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:25.499820 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ae721566-f4b2-4400-b5f0-91a83cfeda38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:25.500604 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ae721566-f4b2-4400-b5f0-91a83cfeda38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:25.501032 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ae721566-f4b2-4400-b5f0-91a83cfeda38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:25.520225 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c28547e9-a3c2-4115-889c-755dc4b59aff tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:25.528181 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c28547e9-a3c2-4115-889c-755dc4b59aff tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.153820 Jun 28 03:18:25.528761 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 46/94] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:25 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:25.554953 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dd6ec7d6-590b-46c4-8ce3-7ac3170557f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:25.555619 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dd6ec7d6-590b-46c4-8ce3-7ac3170557f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:25.562204 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd6ec7d6-590b-46c4-8ce3-7ac3170557f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:25.562646 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd6ec7d6-590b-46c4-8ce3-7ac3170557f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:25.563402 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd6ec7d6-590b-46c4-8ce3-7ac3170557f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:25.563826 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd6ec7d6-590b-46c4-8ce3-7ac3170557f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:25.635490 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dd6ec7d6-590b-46c4-8ce3-7ac3170557f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:25.643690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dd6ec7d6-590b-46c4-8ce3-7ac3170557f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1293 microversion: 2.1 time: 0.092591 Jun 28 03:18:25.644270 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 47/95] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:25 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:18:25.659125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ae721566-f4b2-4400-b5f0-91a83cfeda38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:25.668956 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ae721566-f4b2-4400-b5f0-91a83cfeda38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:25.670428 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ae721566-f4b2-4400-b5f0-91a83cfeda38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:25.671539 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ae721566-f4b2-4400-b5f0-91a83cfeda38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.183197 Jun 28 03:18:25.672102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 49/96] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:25 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:26.545900 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fa5d79d2-2fc0-404b-ba96-33d6806d06e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:26.546467 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fa5d79d2-2fc0-404b-ba96-33d6806d06e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:26.555002 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa5d79d2-2fc0-404b-ba96-33d6806d06e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:26.556421 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa5d79d2-2fc0-404b-ba96-33d6806d06e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:26.559521 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa5d79d2-2fc0-404b-ba96-33d6806d06e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:26.561441 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa5d79d2-2fc0-404b-ba96-33d6806d06e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:26.660581 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c7c4bb9b-df0b-4d7e-ab94-caab7cb09388 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:26.662332 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c7c4bb9b-df0b-4d7e-ab94-caab7cb09388 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:26.668909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7c4bb9b-df0b-4d7e-ab94-caab7cb09388 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:26.669422 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7c4bb9b-df0b-4d7e-ab94-caab7cb09388 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:26.670187 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7c4bb9b-df0b-4d7e-ab94-caab7cb09388 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:26.671420 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7c4bb9b-df0b-4d7e-ab94-caab7cb09388 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:26.732555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fa5d79d2-2fc0-404b-ba96-33d6806d06e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:26.745718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fa5d79d2-2fc0-404b-ba96-33d6806d06e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.201733 Jun 28 03:18:26.755621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 48/97] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:26 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:26.755621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cb1f3ca5-70ed-4b0c-a6fc-79b763d77242 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:26.755621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cb1f3ca5-70ed-4b0c-a6fc-79b763d77242 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:26.758701 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cb1f3ca5-70ed-4b0c-a6fc-79b763d77242 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:26.759307 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cb1f3ca5-70ed-4b0c-a6fc-79b763d77242 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:26.760300 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cb1f3ca5-70ed-4b0c-a6fc-79b763d77242 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:26.760974 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cb1f3ca5-70ed-4b0c-a6fc-79b763d77242 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:26.764368 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c7c4bb9b-df0b-4d7e-ab94-caab7cb09388 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:26.775613 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c7c4bb9b-df0b-4d7e-ab94-caab7cb09388 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1301 microversion: 2.1 time: 0.119357 Jun 28 03:18:26.776580 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 50/98] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:26 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1301 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:26.919598 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cb1f3ca5-70ed-4b0c-a6fc-79b763d77242 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:26.930316 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cb1f3ca5-70ed-4b0c-a6fc-79b763d77242 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:26.932604 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cb1f3ca5-70ed-4b0c-a6fc-79b763d77242 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:26.935892 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cb1f3ca5-70ed-4b0c-a6fc-79b763d77242 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.187515 Jun 28 03:18:26.936536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 49/99] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:26 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:27.763296 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e9ead052-c1a7-4d20-940a-4f8b5bd2ada8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:27.763898 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e9ead052-c1a7-4d20-940a-4f8b5bd2ada8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:27.770537 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e9ead052-c1a7-4d20-940a-4f8b5bd2ada8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:27.771103 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e9ead052-c1a7-4d20-940a-4f8b5bd2ada8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:27.771946 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e9ead052-c1a7-4d20-940a-4f8b5bd2ada8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:27.772483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e9ead052-c1a7-4d20-940a-4f8b5bd2ada8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:27.792295 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-948bebbc-fdca-4a0d-9acb-1a5e9e067b6f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:27.793611 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-948bebbc-fdca-4a0d-9acb-1a5e9e067b6f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:27.800002 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-948bebbc-fdca-4a0d-9acb-1a5e9e067b6f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:27.800691 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-948bebbc-fdca-4a0d-9acb-1a5e9e067b6f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:27.801657 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-948bebbc-fdca-4a0d-9acb-1a5e9e067b6f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:27.802284 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-948bebbc-fdca-4a0d-9acb-1a5e9e067b6f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:27.871734 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-948bebbc-fdca-4a0d-9acb-1a5e9e067b6f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:27.879477 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-948bebbc-fdca-4a0d-9acb-1a5e9e067b6f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1301 microversion: 2.1 time: 0.091267 Jun 28 03:18:27.880059 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 50/100] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:27 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:18:27.942189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e9ead052-c1a7-4d20-940a-4f8b5bd2ada8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:27.951906 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e9ead052-c1a7-4d20-940a-4f8b5bd2ada8 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.192554 Jun 28 03:18:27.952508 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 51/101] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:27 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:27.954449 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f796df97-77a5-45e6-8aa5-40d08440b91d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:27.955224 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f796df97-77a5-45e6-8aa5-40d08440b91d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:27.962397 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f796df97-77a5-45e6-8aa5-40d08440b91d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:27.962945 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f796df97-77a5-45e6-8aa5-40d08440b91d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:27.964259 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f796df97-77a5-45e6-8aa5-40d08440b91d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:27.964765 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f796df97-77a5-45e6-8aa5-40d08440b91d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:28.098446 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f796df97-77a5-45e6-8aa5-40d08440b91d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:28.106766 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f796df97-77a5-45e6-8aa5-40d08440b91d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:28.108274 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f796df97-77a5-45e6-8aa5-40d08440b91d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:28.109378 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f796df97-77a5-45e6-8aa5-40d08440b91d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.159124 Jun 28 03:18:28.109943 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 51/102] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:27 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:18:28.905445 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b7c4fd63-628c-45f7-b4b6-db8de0b1f45f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:28.906417 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b7c4fd63-628c-45f7-b4b6-db8de0b1f45f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:28.916654 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b7c4fd63-628c-45f7-b4b6-db8de0b1f45f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:28.917376 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b7c4fd63-628c-45f7-b4b6-db8de0b1f45f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:28.918605 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b7c4fd63-628c-45f7-b4b6-db8de0b1f45f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:28.919305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b7c4fd63-628c-45f7-b4b6-db8de0b1f45f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:28.969100 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-81a70ba6-0b31-446d-b1ff-d58850f33860 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:28.969679 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-81a70ba6-0b31-446d-b1ff-d58850f33860 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:28.976282 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81a70ba6-0b31-446d-b1ff-d58850f33860 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:28.976716 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81a70ba6-0b31-446d-b1ff-d58850f33860 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:28.977440 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81a70ba6-0b31-446d-b1ff-d58850f33860 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:28.977865 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81a70ba6-0b31-446d-b1ff-d58850f33860 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:28.989506 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b7c4fd63-628c-45f7-b4b6-db8de0b1f45f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:28.997168 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b7c4fd63-628c-45f7-b4b6-db8de0b1f45f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1301 microversion: 2.1 time: 0.098242 Jun 28 03:18:28.998005 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 52/103] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:28 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:29.120629 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-81a70ba6-0b31-446d-b1ff-d58850f33860 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:29.128266 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-81a70ba6-0b31-446d-b1ff-d58850f33860 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.162981 Jun 28 03:18:29.128457 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-afd2f136-b3ad-4b29-9cad-02f71e855199 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:29.128835 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 52/104] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:28 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:29.128985 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-afd2f136-b3ad-4b29-9cad-02f71e855199 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:29.135823 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-afd2f136-b3ad-4b29-9cad-02f71e855199 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:29.136297 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-afd2f136-b3ad-4b29-9cad-02f71e855199 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:29.137023 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-afd2f136-b3ad-4b29-9cad-02f71e855199 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:29.137469 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-afd2f136-b3ad-4b29-9cad-02f71e855199 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:29.279092 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-afd2f136-b3ad-4b29-9cad-02f71e855199 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:29.287222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-afd2f136-b3ad-4b29-9cad-02f71e855199 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:29.288725 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-afd2f136-b3ad-4b29-9cad-02f71e855199 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:29.289821 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-afd2f136-b3ad-4b29-9cad-02f71e855199 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.165398 Jun 28 03:18:29.290354 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 53/105] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:29 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:30.018921 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-08df15d2-f220-423e-aed1-6797d9e5accf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:30.019733 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-08df15d2-f220-423e-aed1-6797d9e5accf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:30.031038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-08df15d2-f220-423e-aed1-6797d9e5accf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:30.031780 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-08df15d2-f220-423e-aed1-6797d9e5accf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:30.033102 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-08df15d2-f220-423e-aed1-6797d9e5accf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:30.033816 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-08df15d2-f220-423e-aed1-6797d9e5accf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:30.111178 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-08df15d2-f220-423e-aed1-6797d9e5accf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:30.121244 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-08df15d2-f220-423e-aed1-6797d9e5accf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1301 microversion: 2.1 time: 0.108980 Jun 28 03:18:30.121972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 53/106] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:30 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1301 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:30.145391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9aa89529-d334-4d4a-8cae-b2ce211c1480 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:30.145989 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-9aa89529-d334-4d4a-8cae-b2ce211c1480 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:30.152855 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9aa89529-d334-4d4a-8cae-b2ce211c1480 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:30.153825 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9aa89529-d334-4d4a-8cae-b2ce211c1480 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:30.155062 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9aa89529-d334-4d4a-8cae-b2ce211c1480 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:30.155539 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9aa89529-d334-4d4a-8cae-b2ce211c1480 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:30.310360 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8b12016b-d80a-4f00-8579-fe36aa14454b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:30.312876 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8b12016b-d80a-4f00-8579-fe36aa14454b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:30.332471 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8b12016b-d80a-4f00-8579-fe36aa14454b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:30.334187 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8b12016b-d80a-4f00-8579-fe36aa14454b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:30.335552 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8b12016b-d80a-4f00-8579-fe36aa14454b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:30.338054 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8b12016b-d80a-4f00-8579-fe36aa14454b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:30.561657 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9aa89529-d334-4d4a-8cae-b2ce211c1480 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:30.570627 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-9aa89529-d334-4d4a-8cae-b2ce211c1480 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.428957 Jun 28 03:18:30.571977 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 54/107] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:30 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:30.664229 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8b12016b-d80a-4f00-8579-fe36aa14454b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:30.673343 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8b12016b-d80a-4f00-8579-fe36aa14454b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:30.674935 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8b12016b-d80a-4f00-8579-fe36aa14454b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:30.676422 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8b12016b-d80a-4f00-8579-fe36aa14454b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.372259 Jun 28 03:18:30.676971 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 54/108] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:30 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:18:31.139283 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-5d5dc56d-6d2b-412b-b411-06b3505eb9ac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:31.140187 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-5d5dc56d-6d2b-412b-b411-06b3505eb9ac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:31.146993 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5d5dc56d-6d2b-412b-b411-06b3505eb9ac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:31.148268 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5d5dc56d-6d2b-412b-b411-06b3505eb9ac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:31.149241 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5d5dc56d-6d2b-412b-b411-06b3505eb9ac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:31.150292 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5d5dc56d-6d2b-412b-b411-06b3505eb9ac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:31.591534 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a4a21e82-8503-4bea-b294-5ceec7c11b28 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:31.591534 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a4a21e82-8503-4bea-b294-5ceec7c11b28 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:31.596442 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-5d5dc56d-6d2b-412b-b411-06b3505eb9ac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:31.603264 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a4a21e82-8503-4bea-b294-5ceec7c11b28 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:31.603706 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a4a21e82-8503-4bea-b294-5ceec7c11b28 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:31.604902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a4a21e82-8503-4bea-b294-5ceec7c11b28 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:31.605386 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a4a21e82-8503-4bea-b294-5ceec7c11b28 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:31.607215 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-5d5dc56d-6d2b-412b-b411-06b3505eb9ac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.472034 Jun 28 03:18:31.608333 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 55/109] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:31 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:31.697573 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9443e71b-e375-49fe-93fe-ff168e408676 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:31.698623 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-9443e71b-e375-49fe-93fe-ff168e408676 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:31.710908 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9443e71b-e375-49fe-93fe-ff168e408676 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:31.713651 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9443e71b-e375-49fe-93fe-ff168e408676 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:31.715955 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9443e71b-e375-49fe-93fe-ff168e408676 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:31.717925 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9443e71b-e375-49fe-93fe-ff168e408676 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:31.832194 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a4a21e82-8503-4bea-b294-5ceec7c11b28 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:31.844899 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a4a21e82-8503-4bea-b294-5ceec7c11b28 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.259910 Jun 28 03:18:31.845593 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 55/110] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:31 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:18:31.936707 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9443e71b-e375-49fe-93fe-ff168e408676 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:31.944967 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9443e71b-e375-49fe-93fe-ff168e408676 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:31.948206 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9443e71b-e375-49fe-93fe-ff168e408676 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:31.949633 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-9443e71b-e375-49fe-93fe-ff168e408676 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.259987 Jun 28 03:18:31.950400 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 56/111] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:31 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:18:32.408094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-5b2647aa-e3b6-4389-b1bb-592cd566252e req-4c23847b-e640-47ab-b736-188801428e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e", "tag": "d6e55600-5f0a-4fbe-a2ac-19740c81c992"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:18:32.423791 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-5b2647aa-e3b6-4389-b1bb-592cd566252e req-4c23847b-e640-47ab-b736-188801428e32 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:32.424576 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-5b2647aa-e3b6-4389-b1bb-592cd566252e req-4c23847b-e640-47ab-b736-188801428e32 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:32.464667 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-5b2647aa-e3b6-4389-b1bb-592cd566252e req-4c23847b-e640-47ab-b736-188801428e32 service nova] Creating event network-changed:d6e55600-5f0a-4fbe-a2ac-19740c81c992 for instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e on hv-cinder-84684 Jun 28 03:18:32.465223 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-5b2647aa-e3b6-4389-b1bb-592cd566252e req-4c23847b-e640-47ab-b736-188801428e32 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 28 03:18:32.466873 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-edd27bab-48d6-4dfc-8d65-a6686081f7eb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:32.467321 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-edd27bab-48d6-4dfc-8d65-a6686081f7eb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:32.468545 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-edd27bab-48d6-4dfc-8d65-a6686081f7eb None None] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:32.469194 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-edd27bab-48d6-4dfc-8d65-a6686081f7eb None None] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:32.498143 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.compute.rpcapi [None req-edd27bab-48d6-4dfc-8d65-a6686081f7eb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 28 03:18:32.499414 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-edd27bab-48d6-4dfc-8d65-a6686081f7eb None None] Releasing lock "compute-rpcapi-router" {{(pid=117680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 28 03:18:32.536536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-edd27bab-48d6-4dfc-8d65-a6686081f7eb None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133221 Jun 28 03:18:32.537270 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 56/112] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:18:32.626843 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-57f4582a-cec7-4cb0-b5e5-bf0cd4d1a0ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:32.627466 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-57f4582a-cec7-4cb0-b5e5-bf0cd4d1a0ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:32.635321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-57f4582a-cec7-4cb0-b5e5-bf0cd4d1a0ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:32.636040 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-57f4582a-cec7-4cb0-b5e5-bf0cd4d1a0ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:32.636849 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-57f4582a-cec7-4cb0-b5e5-bf0cd4d1a0ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:32.637278 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-57f4582a-cec7-4cb0-b5e5-bf0cd4d1a0ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:32.864360 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fd662282-9a4c-488c-a1b3-a4386ff2d686 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:32.865570 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fd662282-9a4c-488c-a1b3-a4386ff2d686 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:32.876372 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd662282-9a4c-488c-a1b3-a4386ff2d686 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:32.877156 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd662282-9a4c-488c-a1b3-a4386ff2d686 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:32.879046 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd662282-9a4c-488c-a1b3-a4386ff2d686 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:32.879725 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd662282-9a4c-488c-a1b3-a4386ff2d686 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:32.945469 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-57f4582a-cec7-4cb0-b5e5-bf0cd4d1a0ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:32.954521 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-57f4582a-cec7-4cb0-b5e5-bf0cd4d1a0ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.333751 Jun 28 03:18:32.954999 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 57/113] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:32 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:32.974199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b3bba008-4517-4df9-88ef-6981015ce30d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:32.975605 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b3bba008-4517-4df9-88ef-6981015ce30d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:32.987395 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b3bba008-4517-4df9-88ef-6981015ce30d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:32.988795 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b3bba008-4517-4df9-88ef-6981015ce30d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:32.989958 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b3bba008-4517-4df9-88ef-6981015ce30d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:32.990537 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b3bba008-4517-4df9-88ef-6981015ce30d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:33.283725 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fd662282-9a4c-488c-a1b3-a4386ff2d686 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:33.303369 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fd662282-9a4c-488c-a1b3-a4386ff2d686 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.444434 Jun 28 03:18:33.320511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 57/114] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:32 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:18:33.427606 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b3bba008-4517-4df9-88ef-6981015ce30d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:33.436119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b3bba008-4517-4df9-88ef-6981015ce30d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:33.437655 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b3bba008-4517-4df9-88ef-6981015ce30d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:33.438723 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b3bba008-4517-4df9-88ef-6981015ce30d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.469269 Jun 28 03:18:33.439270 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 58/115] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:32 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:18:33.973470 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-02ed1e38-e0c0-4669-a6d4-623fe1aa666c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:33.974561 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-02ed1e38-e0c0-4669-a6d4-623fe1aa666c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:33.989622 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02ed1e38-e0c0-4669-a6d4-623fe1aa666c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:33.991127 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02ed1e38-e0c0-4669-a6d4-623fe1aa666c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:33.992674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02ed1e38-e0c0-4669-a6d4-623fe1aa666c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:33.993926 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02ed1e38-e0c0-4669-a6d4-623fe1aa666c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:34.154962 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-02ed1e38-e0c0-4669-a6d4-623fe1aa666c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:34.159191 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:34.167242 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-02ed1e38-e0c0-4669-a6d4-623fe1aa666c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.197852 Jun 28 03:18:34.168110 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 58/116] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:33 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:34.322592 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-09e1a980-2c63-4f2e-86be-f1e0a277e4e9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:34.323205 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-09e1a980-2c63-4f2e-86be-f1e0a277e4e9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:34.332367 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-09e1a980-2c63-4f2e-86be-f1e0a277e4e9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:34.348643 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-09e1a980-2c63-4f2e-86be-f1e0a277e4e9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:34.351543 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-09e1a980-2c63-4f2e-86be-f1e0a277e4e9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:34.352391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-09e1a980-2c63-4f2e-86be-f1e0a277e4e9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:34.458376 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b168d66d-ab04-4f09-bbd4-da32c6eff1bd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:34.459139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b168d66d-ab04-4f09-bbd4-da32c6eff1bd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:34.468882 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b168d66d-ab04-4f09-bbd4-da32c6eff1bd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:34.469326 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b168d66d-ab04-4f09-bbd4-da32c6eff1bd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:34.470093 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b168d66d-ab04-4f09-bbd4-da32c6eff1bd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:34.470517 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b168d66d-ab04-4f09-bbd4-da32c6eff1bd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:34.784932 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-09e1a980-2c63-4f2e-86be-f1e0a277e4e9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:34.808812 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-09e1a980-2c63-4f2e-86be-f1e0a277e4e9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.486836 Jun 28 03:18:34.810835 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 59/117] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:34 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:34.944189 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b168d66d-ab04-4f09-bbd4-da32c6eff1bd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:34.957541 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b168d66d-ab04-4f09-bbd4-da32c6eff1bd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:34.959917 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b168d66d-ab04-4f09-bbd4-da32c6eff1bd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:34.961347 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b168d66d-ab04-4f09-bbd4-da32c6eff1bd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.508158 Jun 28 03:18:34.963312 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 59/118] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:34 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:35.186233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6104bac2-019b-49d6-bc60-bdf667c2ebc5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:35.186852 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6104bac2-019b-49d6-bc60-bdf667c2ebc5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:35.211582 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6104bac2-019b-49d6-bc60-bdf667c2ebc5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:35.212034 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6104bac2-019b-49d6-bc60-bdf667c2ebc5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:35.216389 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6104bac2-019b-49d6-bc60-bdf667c2ebc5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:35.217029 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6104bac2-019b-49d6-bc60-bdf667c2ebc5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:35.553264 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-67793f2e-88a3-4340-a6a8-86acb73fe830 req-cd7d430e-1362-40f1-8b3b-98602e5b797f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf28320-d40d-457d-8b03-3157d65b8a18", "name": "network-vif-plugged", "status": "completed", "tag": "06f883b9-139a-473c-971e-de82ca62f9ab"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:18:35.562257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-67793f2e-88a3-4340-a6a8-86acb73fe830 req-cd7d430e-1362-40f1-8b3b-98602e5b797f service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:35.563020 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-67793f2e-88a3-4340-a6a8-86acb73fe830 req-cd7d430e-1362-40f1-8b3b-98602e5b797f service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:35.575005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-67793f2e-88a3-4340-a6a8-86acb73fe830 req-cd7d430e-1362-40f1-8b3b-98602e5b797f service nova] Creating event network-vif-plugged:06f883b9-139a-473c-971e-de82ca62f9ab for instance bcf28320-d40d-457d-8b03-3157d65b8a18 on hv-cinder-84684 Jun 28 03:18:35.581047 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-67793f2e-88a3-4340-a6a8-86acb73fe830 req-cd7d430e-1362-40f1-8b3b-98602e5b797f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098428 Jun 28 03:18:35.581837 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 60/119] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:18:35.613849 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6104bac2-019b-49d6-bc60-bdf667c2ebc5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:35.630551 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=100 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:35.634711 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6104bac2-019b-49d6-bc60-bdf667c2ebc5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.454094 Jun 28 03:18:35.635671 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 60/120] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:35 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:35.827794 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-51428062-f94f-476e-b29c-c96335ec7db7 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:35.828810 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-51428062-f94f-476e-b29c-c96335ec7db7 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:35.834999 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51428062-f94f-476e-b29c-c96335ec7db7 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:35.835438 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51428062-f94f-476e-b29c-c96335ec7db7 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:35.836206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51428062-f94f-476e-b29c-c96335ec7db7 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:35.836786 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51428062-f94f-476e-b29c-c96335ec7db7 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:35.983681 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b082f1c0-e0eb-45c0-a161-61899879edd1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:35.984324 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b082f1c0-e0eb-45c0-a161-61899879edd1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:35.996110 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b082f1c0-e0eb-45c0-a161-61899879edd1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:35.996589 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b082f1c0-e0eb-45c0-a161-61899879edd1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:35.997363 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b082f1c0-e0eb-45c0-a161-61899879edd1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:35.997803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b082f1c0-e0eb-45c0-a161-61899879edd1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:36.021587 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-51428062-f94f-476e-b29c-c96335ec7db7 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:36.037956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-51428062-f94f-476e-b29c-c96335ec7db7 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.214396 Jun 28 03:18:36.044336 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 61/121] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:35 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:36.183215 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b082f1c0-e0eb-45c0-a161-61899879edd1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:36.192505 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b082f1c0-e0eb-45c0-a161-61899879edd1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:36.194590 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b082f1c0-e0eb-45c0-a161-61899879edd1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:36.196290 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b082f1c0-e0eb-45c0-a161-61899879edd1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.217556 Jun 28 03:18:36.207762 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 61/122] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:35 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:36.651692 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-187f153a-8f00-4ae7-83bc-daf5f15aa5a9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:36.652326 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-187f153a-8f00-4ae7-83bc-daf5f15aa5a9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:36.658341 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-187f153a-8f00-4ae7-83bc-daf5f15aa5a9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:36.658783 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-187f153a-8f00-4ae7-83bc-daf5f15aa5a9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:36.659536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-187f153a-8f00-4ae7-83bc-daf5f15aa5a9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:36.659963 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-187f153a-8f00-4ae7-83bc-daf5f15aa5a9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:36.811896 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-187f153a-8f00-4ae7-83bc-daf5f15aa5a9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:36.820062 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-187f153a-8f00-4ae7-83bc-daf5f15aa5a9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.172353 Jun 28 03:18:36.820675 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 62/123] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:36 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:37.058275 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-5e6e63bb-797f-4fd1-8568-9d0f9d95bed5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:37.059025 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-5e6e63bb-797f-4fd1-8568-9d0f9d95bed5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:37.067346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5e6e63bb-797f-4fd1-8568-9d0f9d95bed5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:37.068216 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5e6e63bb-797f-4fd1-8568-9d0f9d95bed5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:37.068992 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5e6e63bb-797f-4fd1-8568-9d0f9d95bed5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:37.069820 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5e6e63bb-797f-4fd1-8568-9d0f9d95bed5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:37.215773 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-aa4726af-bfd6-450e-8249-76e3a612a2a7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:37.216481 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-aa4726af-bfd6-450e-8249-76e3a612a2a7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:37.220576 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-5e6e63bb-797f-4fd1-8568-9d0f9d95bed5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:37.224040 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aa4726af-bfd6-450e-8249-76e3a612a2a7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:37.224841 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aa4726af-bfd6-450e-8249-76e3a612a2a7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:37.226253 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aa4726af-bfd6-450e-8249-76e3a612a2a7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:37.226760 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aa4726af-bfd6-450e-8249-76e3a612a2a7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:37.231388 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-5e6e63bb-797f-4fd1-8568-9d0f9d95bed5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.177145 Jun 28 03:18:37.242385 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 62/124] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:37 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:37.362903 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-aa4726af-bfd6-450e-8249-76e3a612a2a7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:37.371468 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-aa4726af-bfd6-450e-8249-76e3a612a2a7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:37.373361 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-aa4726af-bfd6-450e-8249-76e3a612a2a7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:37.374699 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-aa4726af-bfd6-450e-8249-76e3a612a2a7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.163740 Jun 28 03:18:37.375779 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 63/125] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:37 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:18:37.838101 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d617a264-486d-479b-a6db-0b64090a6cb6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:37.838751 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d617a264-486d-479b-a6db-0b64090a6cb6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:37.846597 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d617a264-486d-479b-a6db-0b64090a6cb6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:37.847154 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d617a264-486d-479b-a6db-0b64090a6cb6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:37.848217 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d617a264-486d-479b-a6db-0b64090a6cb6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:37.848733 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d617a264-486d-479b-a6db-0b64090a6cb6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:38.005084 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d617a264-486d-479b-a6db-0b64090a6cb6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:38.013271 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d617a264-486d-479b-a6db-0b64090a6cb6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.180279 Jun 28 03:18:38.014131 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 63/126] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:37 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:38.248733 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bd711836-de9e-4664-9d30-5f26087715d6 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:38.249253 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-bd711836-de9e-4664-9d30-5f26087715d6 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:38.255251 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd711836-de9e-4664-9d30-5f26087715d6 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:38.255667 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd711836-de9e-4664-9d30-5f26087715d6 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:38.256651 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd711836-de9e-4664-9d30-5f26087715d6 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:38.257074 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd711836-de9e-4664-9d30-5f26087715d6 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:38.394468 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b285fb55-dffd-43b5-bc21-605a501248d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:38.395163 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b285fb55-dffd-43b5-bc21-605a501248d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:38.403134 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b285fb55-dffd-43b5-bc21-605a501248d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:38.403580 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b285fb55-dffd-43b5-bc21-605a501248d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:38.404380 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b285fb55-dffd-43b5-bc21-605a501248d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:38.404812 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b285fb55-dffd-43b5-bc21-605a501248d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:38.412140 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-bd711836-de9e-4664-9d30-5f26087715d6 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:38.424781 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-bd711836-de9e-4664-9d30-5f26087715d6 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.179760 Jun 28 03:18:38.428144 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 64/127] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:38 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:38.564397 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b285fb55-dffd-43b5-bc21-605a501248d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:38.575550 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b285fb55-dffd-43b5-bc21-605a501248d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:38.577469 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b285fb55-dffd-43b5-bc21-605a501248d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:38.578846 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b285fb55-dffd-43b5-bc21-605a501248d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.188931 Jun 28 03:18:38.584231 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 64/128] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:38 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:18:38.819944 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-1193bf82-638f-48a0-98f0-a5fd31a37afe req-226e2834-5601-479f-b465-c4b35bd2c6ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f3fd86-9d6c-4d2e-8997-579c77adc3f0", "name": "network-vif-plugged", "status": "completed", "tag": "9e28a86b-c03c-4271-880f-a8d72e9df423"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:18:38.830145 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-1193bf82-638f-48a0-98f0-a5fd31a37afe req-226e2834-5601-479f-b465-c4b35bd2c6ce service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:38.830606 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-1193bf82-638f-48a0-98f0-a5fd31a37afe req-226e2834-5601-479f-b465-c4b35bd2c6ce service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:38.842820 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-1193bf82-638f-48a0-98f0-a5fd31a37afe req-226e2834-5601-479f-b465-c4b35bd2c6ce service nova] Creating event network-vif-plugged:9e28a86b-c03c-4271-880f-a8d72e9df423 for instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 on hv-cinder-84684 Jun 28 03:18:38.847988 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-1193bf82-638f-48a0-98f0-a5fd31a37afe req-226e2834-5601-479f-b465-c4b35bd2c6ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031784 Jun 28 03:18:38.848787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 65/129] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:18:39.030765 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-acd997ca-dd08-4b87-ba80-147e5c2c8775 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:39.031549 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-acd997ca-dd08-4b87-ba80-147e5c2c8775 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:39.037880 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-acd997ca-dd08-4b87-ba80-147e5c2c8775 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:39.038233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-acd997ca-dd08-4b87-ba80-147e5c2c8775 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:39.039117 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-acd997ca-dd08-4b87-ba80-147e5c2c8775 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:39.039626 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-acd997ca-dd08-4b87-ba80-147e5c2c8775 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:39.181359 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-acd997ca-dd08-4b87-ba80-147e5c2c8775 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:39.189718 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-acd997ca-dd08-4b87-ba80-147e5c2c8775 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.163365 Jun 28 03:18:39.190269 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 65/130] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:39 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:39.442312 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1a94ef38-a32a-41f9-ab03-1bb808127432 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:39.443082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1a94ef38-a32a-41f9-ab03-1bb808127432 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:39.451381 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a94ef38-a32a-41f9-ab03-1bb808127432 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:39.452008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a94ef38-a32a-41f9-ab03-1bb808127432 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:39.453389 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a94ef38-a32a-41f9-ab03-1bb808127432 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:39.456460 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a94ef38-a32a-41f9-ab03-1bb808127432 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:39.596574 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8129b073-fdb2-4d5c-a1fa-ec82bb46b8d4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:39.597173 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-8129b073-fdb2-4d5c-a1fa-ec82bb46b8d4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:39.603854 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8129b073-fdb2-4d5c-a1fa-ec82bb46b8d4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:39.608357 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1a94ef38-a32a-41f9-ab03-1bb808127432 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:39.609021 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8129b073-fdb2-4d5c-a1fa-ec82bb46b8d4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:39.609845 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8129b073-fdb2-4d5c-a1fa-ec82bb46b8d4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:39.610626 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8129b073-fdb2-4d5c-a1fa-ec82bb46b8d4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:39.618345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1a94ef38-a32a-41f9-ab03-1bb808127432 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.180241 Jun 28 03:18:39.619000 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 66/131] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:39 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:39.770472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-8129b073-fdb2-4d5c-a1fa-ec82bb46b8d4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:39.779330 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-8129b073-fdb2-4d5c-a1fa-ec82bb46b8d4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:39.780961 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-8129b073-fdb2-4d5c-a1fa-ec82bb46b8d4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:39.782149 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-8129b073-fdb2-4d5c-a1fa-ec82bb46b8d4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.189487 Jun 28 03:18:39.782892 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 66/132] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:39 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:18:40.207500 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-126adbae-c379-4fee-a3a7-ae052cb17458 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:40.208238 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-126adbae-c379-4fee-a3a7-ae052cb17458 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:40.215034 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-126adbae-c379-4fee-a3a7-ae052cb17458 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:40.215543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-126adbae-c379-4fee-a3a7-ae052cb17458 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:40.216330 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-126adbae-c379-4fee-a3a7-ae052cb17458 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:40.216818 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-126adbae-c379-4fee-a3a7-ae052cb17458 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:40.369208 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-126adbae-c379-4fee-a3a7-ae052cb17458 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:40.378314 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-126adbae-c379-4fee-a3a7-ae052cb17458 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.175413 Jun 28 03:18:40.379029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 67/133] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:40 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:40.637822 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-36d21f03-843a-4dcd-b9cf-46caad0ac2b3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:40.638559 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-36d21f03-843a-4dcd-b9cf-46caad0ac2b3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:40.644766 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-36d21f03-843a-4dcd-b9cf-46caad0ac2b3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:40.645488 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-36d21f03-843a-4dcd-b9cf-46caad0ac2b3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:40.646647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-36d21f03-843a-4dcd-b9cf-46caad0ac2b3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:40.647612 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-36d21f03-843a-4dcd-b9cf-46caad0ac2b3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:40.802750 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9ef86f31-29d9-448d-ad8c-aec69dcabdaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:40.803382 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9ef86f31-29d9-448d-ad8c-aec69dcabdaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:40.811990 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9ef86f31-29d9-448d-ad8c-aec69dcabdaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:40.812873 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9ef86f31-29d9-448d-ad8c-aec69dcabdaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:40.814163 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9ef86f31-29d9-448d-ad8c-aec69dcabdaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:40.815189 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9ef86f31-29d9-448d-ad8c-aec69dcabdaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:40.817334 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-36d21f03-843a-4dcd-b9cf-46caad0ac2b3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:40.826432 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-36d21f03-843a-4dcd-b9cf-46caad0ac2b3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.193058 Jun 28 03:18:40.836042 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 67/134] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:40 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:40.966900 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9ef86f31-29d9-448d-ad8c-aec69dcabdaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:40.975243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9ef86f31-29d9-448d-ad8c-aec69dcabdaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:40.976842 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9ef86f31-29d9-448d-ad8c-aec69dcabdaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:40.978059 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9ef86f31-29d9-448d-ad8c-aec69dcabdaf tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.180958 Jun 28 03:18:40.978595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 68/135] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:40 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:41.396281 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-65deec0c-368e-4808-9baf-9cda45ee0e1d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:41.396878 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-65deec0c-368e-4808-9baf-9cda45ee0e1d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:41.402981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-65deec0c-368e-4808-9baf-9cda45ee0e1d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:41.403405 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-65deec0c-368e-4808-9baf-9cda45ee0e1d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:41.404142 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-65deec0c-368e-4808-9baf-9cda45ee0e1d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:41.404597 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-65deec0c-368e-4808-9baf-9cda45ee0e1d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:41.550043 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-65deec0c-368e-4808-9baf-9cda45ee0e1d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:41.558757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-65deec0c-368e-4808-9baf-9cda45ee0e1d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.166291 Jun 28 03:18:41.559506 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 68/136] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:41 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:41.843569 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1c645ea8-ebf7-4b99-b05c-0bab990dc0f9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:41.844213 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1c645ea8-ebf7-4b99-b05c-0bab990dc0f9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:41.863216 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c645ea8-ebf7-4b99-b05c-0bab990dc0f9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:41.865338 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c645ea8-ebf7-4b99-b05c-0bab990dc0f9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:41.866486 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c645ea8-ebf7-4b99-b05c-0bab990dc0f9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:41.867297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c645ea8-ebf7-4b99-b05c-0bab990dc0f9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:41.996935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f264d54b-9be4-4bad-beb1-499f5aa38fcb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:41.997555 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f264d54b-9be4-4bad-beb1-499f5aa38fcb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:42.010632 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f264d54b-9be4-4bad-beb1-499f5aa38fcb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:42.011322 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f264d54b-9be4-4bad-beb1-499f5aa38fcb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:42.012190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f264d54b-9be4-4bad-beb1-499f5aa38fcb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:42.012610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f264d54b-9be4-4bad-beb1-499f5aa38fcb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:42.015722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1c645ea8-ebf7-4b99-b05c-0bab990dc0f9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:42.023264 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1c645ea8-ebf7-4b99-b05c-0bab990dc0f9 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.183689 Jun 28 03:18:42.023827 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 69/137] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:41 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:42.156967 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-f264d54b-9be4-4bad-beb1-499f5aa38fcb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:42.169851 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-f264d54b-9be4-4bad-beb1-499f5aa38fcb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:42.171315 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-f264d54b-9be4-4bad-beb1-499f5aa38fcb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:42.172528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f264d54b-9be4-4bad-beb1-499f5aa38fcb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.180267 Jun 28 03:18:42.173451 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 69/138] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:41 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:18:42.576838 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-66f831c1-1443-4d30-a01f-a8c98ef0c0e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:42.577668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-66f831c1-1443-4d30-a01f-a8c98ef0c0e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:42.580616 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:42.586569 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-66f831c1-1443-4d30-a01f-a8c98ef0c0e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:42.587007 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-66f831c1-1443-4d30-a01f-a8c98ef0c0e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:42.587793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-66f831c1-1443-4d30-a01f-a8c98ef0c0e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:42.588217 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-66f831c1-1443-4d30-a01f-a8c98ef0c0e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:42.717689 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-66f831c1-1443-4d30-a01f-a8c98ef0c0e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:42.725267 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-66f831c1-1443-4d30-a01f-a8c98ef0c0e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.153286 Jun 28 03:18:42.725847 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 70/139] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:42 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:43.042227 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-90d59e0b-ac6a-4347-9a1c-8be54247c223 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:43.043083 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-90d59e0b-ac6a-4347-9a1c-8be54247c223 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:43.055084 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-90d59e0b-ac6a-4347-9a1c-8be54247c223 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:43.055084 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-90d59e0b-ac6a-4347-9a1c-8be54247c223 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:43.055084 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-90d59e0b-ac6a-4347-9a1c-8be54247c223 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:43.055084 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-90d59e0b-ac6a-4347-9a1c-8be54247c223 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:43.190437 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-90d59e0b-ac6a-4347-9a1c-8be54247c223 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:43.192190 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5f2c4c57-3615-484a-b762-79f5e015602f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:43.192190 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5f2c4c57-3615-484a-b762-79f5e015602f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:43.199057 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5f2c4c57-3615-484a-b762-79f5e015602f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:43.199502 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5f2c4c57-3615-484a-b762-79f5e015602f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:43.200308 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5f2c4c57-3615-484a-b762-79f5e015602f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:43.200705 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5f2c4c57-3615-484a-b762-79f5e015602f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:43.206862 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-90d59e0b-ac6a-4347-9a1c-8be54247c223 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1314 microversion: 2.1 time: 0.168867 Jun 28 03:18:43.207429 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 70/140] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:43 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:43.343389 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5f2c4c57-3615-484a-b762-79f5e015602f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:43.351373 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5f2c4c57-3615-484a-b762-79f5e015602f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:43.352893 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5f2c4c57-3615-484a-b762-79f5e015602f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:43.353983 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5f2c4c57-3615-484a-b762-79f5e015602f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1407 microversion: 2.20 time: 0.167066 Jun 28 03:18:43.354806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 71/141] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:43 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:18:43.743390 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-fcd53ff8-7c73-47f0-b4bf-db7b98ae7a66 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:43.744012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-fcd53ff8-7c73-47f0-b4bf-db7b98ae7a66 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:43.751593 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fcd53ff8-7c73-47f0-b4bf-db7b98ae7a66 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:43.752030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fcd53ff8-7c73-47f0-b4bf-db7b98ae7a66 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:43.752848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fcd53ff8-7c73-47f0-b4bf-db7b98ae7a66 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:43.753271 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fcd53ff8-7c73-47f0-b4bf-db7b98ae7a66 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:43.882376 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-fcd53ff8-7c73-47f0-b4bf-db7b98ae7a66 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:43.890436 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-fcd53ff8-7c73-47f0-b4bf-db7b98ae7a66 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.151590 Jun 28 03:18:43.891003 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 71/142] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:43 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:44.228496 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8e16092b-25e1-46f3-882e-a3e0b4d2ebb3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:44.229274 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8e16092b-25e1-46f3-882e-a3e0b4d2ebb3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:44.237681 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8e16092b-25e1-46f3-882e-a3e0b4d2ebb3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:44.238098 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8e16092b-25e1-46f3-882e-a3e0b4d2ebb3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:44.238973 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8e16092b-25e1-46f3-882e-a3e0b4d2ebb3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:44.239413 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8e16092b-25e1-46f3-882e-a3e0b4d2ebb3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:44.375375 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c565f5f5-4250-4f1d-810f-3f50174a2fd6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:44.375841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c565f5f5-4250-4f1d-810f-3f50174a2fd6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:44.382499 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c565f5f5-4250-4f1d-810f-3f50174a2fd6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:44.383730 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c565f5f5-4250-4f1d-810f-3f50174a2fd6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:44.384675 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c565f5f5-4250-4f1d-810f-3f50174a2fd6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:44.385254 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c565f5f5-4250-4f1d-810f-3f50174a2fd6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:44.403147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8e16092b-25e1-46f3-882e-a3e0b4d2ebb3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:44.411603 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8e16092b-25e1-46f3-882e-a3e0b4d2ebb3 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1500 microversion: 2.1 time: 0.188452 Jun 28 03:18:44.425454 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 72/143] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:44 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1500 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:44.531643 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c565f5f5-4250-4f1d-810f-3f50174a2fd6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:44.540490 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c565f5f5-4250-4f1d-810f-3f50174a2fd6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:44.542104 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c565f5f5-4250-4f1d-810f-3f50174a2fd6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:44.543408 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c565f5f5-4250-4f1d-810f-3f50174a2fd6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1600 microversion: 2.20 time: 0.172410 Jun 28 03:18:44.544027 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 72/144] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:18:44 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:18:44.562887 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b9c07ad9-c7eb-45ce-8cc2-fefa5ace998f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:44.563455 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b9c07ad9-c7eb-45ce-8cc2-fefa5ace998f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:44.569536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9c07ad9-c7eb-45ce-8cc2-fefa5ace998f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:44.569995 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9c07ad9-c7eb-45ce-8cc2-fefa5ace998f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:44.570753 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9c07ad9-c7eb-45ce-8cc2-fefa5ace998f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:44.571218 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9c07ad9-c7eb-45ce-8cc2-fefa5ace998f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:44.714758 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b9c07ad9-c7eb-45ce-8cc2-fefa5ace998f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.155714 Jun 28 03:18:44.715590 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 73/145] 10.222.0.44 () {60 vars in 1315 bytes} [Tue Jun 28 03:18:44 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-interface => generated 285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:18:44.908267 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-910293fa-ec68-424a-b566-bcebfd17333e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:44.908267 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-910293fa-ec68-424a-b566-bcebfd17333e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:44.918311 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-910293fa-ec68-424a-b566-bcebfd17333e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:44.919186 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-910293fa-ec68-424a-b566-bcebfd17333e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:44.922736 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-910293fa-ec68-424a-b566-bcebfd17333e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:44.923480 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-910293fa-ec68-424a-b566-bcebfd17333e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:45.165283 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-910293fa-ec68-424a-b566-bcebfd17333e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:45.176179 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-910293fa-ec68-424a-b566-bcebfd17333e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.273091 Jun 28 03:18:45.179388 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 73/146] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:44 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:45.748937 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-b897de2e-b89e-4202-92dd-9f5f86014221 req-aaaf7642-2d4c-4f2d-b6c3-81ff7d64cb1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e", "name": "network-vif-plugged", "status": "completed", "tag": "d6e55600-5f0a-4fbe-a2ac-19740c81c992"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:18:45.759820 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-b897de2e-b89e-4202-92dd-9f5f86014221 req-aaaf7642-2d4c-4f2d-b6c3-81ff7d64cb1c service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:45.760478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-b897de2e-b89e-4202-92dd-9f5f86014221 req-aaaf7642-2d4c-4f2d-b6c3-81ff7d64cb1c service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:45.773912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-b897de2e-b89e-4202-92dd-9f5f86014221 req-aaaf7642-2d4c-4f2d-b6c3-81ff7d64cb1c service nova] Creating event network-vif-plugged:d6e55600-5f0a-4fbe-a2ac-19740c81c992 for instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e on hv-cinder-84684 Jun 28 03:18:45.800020 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-b897de2e-b89e-4202-92dd-9f5f86014221 req-aaaf7642-2d4c-4f2d-b6c3-81ff7d64cb1c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041229 Jun 28 03:18:45.802394 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 74/147] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:18:45.919403 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7ea8052e-e064-4f1a-9425-ec1a3c3ab1d1 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d13eef8-0798-44c7-9361-c90a91ca2259"}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:18:45.920645 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7ea8052e-e064-4f1a-9425-ec1a3c3ab1d1 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:45.926841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7ea8052e-e064-4f1a-9425-ec1a3c3ab1d1 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:45.927354 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7ea8052e-e064-4f1a-9425-ec1a3c3ab1d1 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:45.928196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7ea8052e-e064-4f1a-9425-ec1a3c3ab1d1 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:45.928695 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7ea8052e-e064-4f1a-9425-ec1a3c3ab1d1 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:46.197178 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cf46846c-2ff0-4062-850b-d8e572b85a08 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:46.198065 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cf46846c-2ff0-4062-850b-d8e572b85a08 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:46.204613 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cf46846c-2ff0-4062-850b-d8e572b85a08 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:46.205046 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cf46846c-2ff0-4062-850b-d8e572b85a08 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:46.205881 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cf46846c-2ff0-4062-850b-d8e572b85a08 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:46.206494 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cf46846c-2ff0-4062-850b-d8e572b85a08 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:46.429620 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cf46846c-2ff0-4062-850b-d8e572b85a08 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:46.437806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cf46846c-2ff0-4062-850b-d8e572b85a08 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.245079 Jun 28 03:18:46.444407 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 75/148] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:46 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:46.444407 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-ff10dd35-7e87-4813-8446-6d33718bc800 req-1b60503f-0112-4a79-9e09-49eaf1e4ce44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62f3fd86-9d6c-4d2e-8997-579c77adc3f0", "tag": "9e28a86b-c03c-4271-880f-a8d72e9df423"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:18:46.452355 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-ff10dd35-7e87-4813-8446-6d33718bc800 req-1b60503f-0112-4a79-9e09-49eaf1e4ce44 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:46.452880 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-ff10dd35-7e87-4813-8446-6d33718bc800 req-1b60503f-0112-4a79-9e09-49eaf1e4ce44 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:46.465105 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-ff10dd35-7e87-4813-8446-6d33718bc800 req-1b60503f-0112-4a79-9e09-49eaf1e4ce44 service nova] Creating event network-changed:9e28a86b-c03c-4271-880f-a8d72e9df423 for instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 on hv-cinder-84684 Jun 28 03:18:46.470900 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-ff10dd35-7e87-4813-8446-6d33718bc800 req-1b60503f-0112-4a79-9e09-49eaf1e4ce44 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030829 Jun 28 03:18:46.472210 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 76/149] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:18:46.580709 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7ea8052e-e064-4f1a-9425-ec1a3c3ab1d1 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "POST /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.661546 Jun 28 03:18:46.582560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 74/150] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:18:45 2022] POST /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:18:47.456566 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0b2e26ed-c175-4cf9-a8b7-c48a8dc7c43c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:47.457842 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0b2e26ed-c175-4cf9-a8b7-c48a8dc7c43c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:47.468779 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0b2e26ed-c175-4cf9-a8b7-c48a8dc7c43c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:47.469508 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0b2e26ed-c175-4cf9-a8b7-c48a8dc7c43c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:47.470923 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0b2e26ed-c175-4cf9-a8b7-c48a8dc7c43c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:47.471546 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0b2e26ed-c175-4cf9-a8b7-c48a8dc7c43c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:47.649370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0b2e26ed-c175-4cf9-a8b7-c48a8dc7c43c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:47.658114 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0b2e26ed-c175-4cf9-a8b7-c48a8dc7c43c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.206243 Jun 28 03:18:47.658701 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 77/151] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:47 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:48.677564 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-68a69cba-d901-4a2c-989b-679f44ef2b2a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:48.678265 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-68a69cba-d901-4a2c-989b-679f44ef2b2a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:48.700711 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-68a69cba-d901-4a2c-989b-679f44ef2b2a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:48.716915 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-68a69cba-d901-4a2c-989b-679f44ef2b2a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:48.719734 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-68a69cba-d901-4a2c-989b-679f44ef2b2a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:48.721527 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-68a69cba-d901-4a2c-989b-679f44ef2b2a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:49.061777 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-68a69cba-d901-4a2c-989b-679f44ef2b2a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:49.078089 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-68a69cba-d901-4a2c-989b-679f44ef2b2a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1366 microversion: 2.1 time: 0.406746 Jun 28 03:18:49.091422 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 75/152] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:48 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1366 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:50.096534 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-52f1e974-bd58-443e-ae97-8d95eb02e6eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:50.097155 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-52f1e974-bd58-443e-ae97-8d95eb02e6eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:50.106474 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-52f1e974-bd58-443e-ae97-8d95eb02e6eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:50.106933 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-52f1e974-bd58-443e-ae97-8d95eb02e6eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:50.107764 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-52f1e974-bd58-443e-ae97-8d95eb02e6eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:50.108138 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-52f1e974-bd58-443e-ae97-8d95eb02e6eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:50.147660 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:50.393286 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-52f1e974-bd58-443e-ae97-8d95eb02e6eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:50.401890 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-52f1e974-bd58-443e-ae97-8d95eb02e6eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1556 microversion: 2.1 time: 0.309367 Jun 28 03:18:50.407735 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 78/153] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:50 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1556 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:18:50.431569 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3ede44b7-0543-4a9f-9028-ae18ea7a49ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:50.432407 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-3ede44b7-0543-4a9f-9028-ae18ea7a49ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:50.444271 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3ede44b7-0543-4a9f-9028-ae18ea7a49ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:50.447064 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3ede44b7-0543-4a9f-9028-ae18ea7a49ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:50.450113 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3ede44b7-0543-4a9f-9028-ae18ea7a49ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:50.452425 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3ede44b7-0543-4a9f-9028-ae18ea7a49ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:50.463605 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:50.557237 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3ede44b7-0543-4a9f-9028-ae18ea7a49ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129289 Jun 28 03:18:50.558351 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 76/154] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 28 03:18:50 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:18:51.792728 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-749bb7d0-c94c-42bc-b6e8-573e92e13ddf req-a742657b-afd5-4c2b-b17a-29908a92075f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e", "tag": "d6e55600-5f0a-4fbe-a2ac-19740c81c992"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:18:51.806991 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-749bb7d0-c94c-42bc-b6e8-573e92e13ddf req-a742657b-afd5-4c2b-b17a-29908a92075f service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:51.807430 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-749bb7d0-c94c-42bc-b6e8-573e92e13ddf req-a742657b-afd5-4c2b-b17a-29908a92075f service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:51.833652 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-749bb7d0-c94c-42bc-b6e8-573e92e13ddf req-a742657b-afd5-4c2b-b17a-29908a92075f service nova] Creating event network-changed:d6e55600-5f0a-4fbe-a2ac-19740c81c992 for instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e on hv-cinder-84684 Jun 28 03:18:51.840693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-749bb7d0-c94c-42bc-b6e8-573e92e13ddf req-a742657b-afd5-4c2b-b17a-29908a92075f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051458 Jun 28 03:18:51.841627 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 79/155] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:18:58.649760 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-84afbebd-5192-48ba-9435-d7696b01aa09 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:58.650367 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-84afbebd-5192-48ba-9435-d7696b01aa09 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:58.652189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=66 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:58.657814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-84afbebd-5192-48ba-9435-d7696b01aa09 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:58.658258 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-84afbebd-5192-48ba-9435-d7696b01aa09 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:58.659056 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-84afbebd-5192-48ba-9435-d7696b01aa09 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:58.659452 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-84afbebd-5192-48ba-9435-d7696b01aa09 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:58.684276 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-84afbebd-5192-48ba-9435-d7696b01aa09 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Going to try to terminate instance {{(pid=117681) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:18:58.786490 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-84afbebd-5192-48ba-9435-d7696b01aa09 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 204 len: 0 microversion: 2.1 time: 0.141152 Jun 28 03:18:58.787082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 77/156] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:18:58 2022] DELETE /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:18:58.796097 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1601c3cd-e44a-44ab-92de-59da1f2f2314 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:58.796830 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1601c3cd-e44a-44ab-92de-59da1f2f2314 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:58.798826 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=74 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:18:58.804290 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1601c3cd-e44a-44ab-92de-59da1f2f2314 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:58.804735 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1601c3cd-e44a-44ab-92de-59da1f2f2314 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:58.805510 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1601c3cd-e44a-44ab-92de-59da1f2f2314 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:58.805944 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1601c3cd-e44a-44ab-92de-59da1f2f2314 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:58.935152 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1601c3cd-e44a-44ab-92de-59da1f2f2314 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:18:58.943845 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1601c3cd-e44a-44ab-92de-59da1f2f2314 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1552 microversion: 2.1 time: 0.152224 Jun 28 03:18:58.944446 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 80/157] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:58 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:18:59.961217 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2125a523-db12-435c-958f-69d89d07abb2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:18:59.961908 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2125a523-db12-435c-958f-69d89d07abb2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:18:59.969465 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2125a523-db12-435c-958f-69d89d07abb2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:59.969896 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2125a523-db12-435c-958f-69d89d07abb2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:18:59.970657 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2125a523-db12-435c-958f-69d89d07abb2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:18:59.971083 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2125a523-db12-435c-958f-69d89d07abb2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:00.104793 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2125a523-db12-435c-958f-69d89d07abb2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:00.113436 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2125a523-db12-435c-958f-69d89d07abb2 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1552 microversion: 2.1 time: 0.156392 Jun 28 03:19:00.114045 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 78/158] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:18:59 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:01.130028 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a931e7cf-33e9-44d0-b632-9354557dc7dc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:01.130652 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a931e7cf-33e9-44d0-b632-9354557dc7dc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:01.136771 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a931e7cf-33e9-44d0-b632-9354557dc7dc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:01.137361 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a931e7cf-33e9-44d0-b632-9354557dc7dc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:01.138108 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a931e7cf-33e9-44d0-b632-9354557dc7dc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:01.138541 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a931e7cf-33e9-44d0-b632-9354557dc7dc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:01.274850 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a931e7cf-33e9-44d0-b632-9354557dc7dc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:01.283502 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a931e7cf-33e9-44d0-b632-9354557dc7dc tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1552 microversion: 2.1 time: 0.157142 Jun 28 03:19:01.284392 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 81/159] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:01 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:02.300612 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a393b39f-7b63-4a6e-b169-cfc9b337f185 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:02.301213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a393b39f-7b63-4a6e-b169-cfc9b337f185 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:02.307911 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a393b39f-7b63-4a6e-b169-cfc9b337f185 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:02.308391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a393b39f-7b63-4a6e-b169-cfc9b337f185 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:02.309261 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a393b39f-7b63-4a6e-b169-cfc9b337f185 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:02.309680 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a393b39f-7b63-4a6e-b169-cfc9b337f185 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:02.481229 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a393b39f-7b63-4a6e-b169-cfc9b337f185 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:02.489716 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a393b39f-7b63-4a6e-b169-cfc9b337f185 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1552 microversion: 2.1 time: 0.193524 Jun 28 03:19:02.490469 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 79/160] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:02 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1552 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:02.764721 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1417896374", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "networks": [{"uuid": "6b3cf016-a33e-448c-823a-e4405f148035"}]}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:02.818343 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] validate_networks() for [('6b3cf016-a33e-448c-823a-e4405f148035', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:19:03.268721 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:19:03.269123 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:19:03.269710 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:19:03.270171 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:19:03.270586 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:19:03.283763 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:03.283763 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:03.283763 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:03.283763 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:03.301194 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Getting quotas for project f2443fc439de4514badcb369d67462b9. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:19:03.305350 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Getting quotas for user 7ffe193c62664564b930b6505754526b and project f2443fc439de4514badcb369d67462b9. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:19:03.317248 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:19:03.319450 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:19:03.364077 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9957f3b3-2996-4a29-b358-66966bd62055 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603117 Jun 28 03:19:03.365090 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 82/161] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:19:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:19:03.375890 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d583ea65-89ef-4f93-a53d-d43ddc859c5e tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:03.375890 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d583ea65-89ef-4f93-a53d-d43ddc859c5e tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:03.441518 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d583ea65-89ef-4f93-a53d-d43ddc859c5e tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:03.448675 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d583ea65-89ef-4f93-a53d-d43ddc859c5e tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1214 microversion: 2.1 time: 0.077398 Jun 28 03:19:03.457481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 80/162] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:03 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:03.507156 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-00d938d1-928c-4a03-ab1d-68da8216348b tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:03.507710 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-00d938d1-928c-4a03-ab1d-68da8216348b tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:03.514880 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-00d938d1-928c-4a03-ab1d-68da8216348b tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:03.516957 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-00d938d1-928c-4a03-ab1d-68da8216348b tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:03.517580 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-00d938d1-928c-4a03-ab1d-68da8216348b tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:03.518017 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-00d938d1-928c-4a03-ab1d-68da8216348b tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:03.681182 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-00d938d1-928c-4a03-ab1d-68da8216348b tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:03.690838 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-00d938d1-928c-4a03-ab1d-68da8216348b tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1552 microversion: 2.1 time: 0.187592 Jun 28 03:19:03.691299 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 83/163] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:03 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1552 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:04.465663 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-5ee4a205-343d-4433-abd3-a57161c22482 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:04.466514 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-5ee4a205-343d-4433-abd3-a57161c22482 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:04.473453 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5ee4a205-343d-4433-abd3-a57161c22482 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:04.473944 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5ee4a205-343d-4433-abd3-a57161c22482 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:04.474704 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5ee4a205-343d-4433-abd3-a57161c22482 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:04.475130 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5ee4a205-343d-4433-abd3-a57161c22482 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:04.552434 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-5ee4a205-343d-4433-abd3-a57161c22482 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:04.561709 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-5ee4a205-343d-4433-abd3-a57161c22482 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1218 microversion: 2.1 time: 0.100222 Jun 28 03:19:04.562273 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 81/164] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:04 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:04.708480 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a87cffcb-bc71-490e-ab7a-0309d22e4f35 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:04.709045 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a87cffcb-bc71-490e-ab7a-0309d22e4f35 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:04.715123 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a87cffcb-bc71-490e-ab7a-0309d22e4f35 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:04.715562 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a87cffcb-bc71-490e-ab7a-0309d22e4f35 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:04.716366 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a87cffcb-bc71-490e-ab7a-0309d22e4f35 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:04.716795 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a87cffcb-bc71-490e-ab7a-0309d22e4f35 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:04.849498 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a87cffcb-bc71-490e-ab7a-0309d22e4f35 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:04.857812 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a87cffcb-bc71-490e-ab7a-0309d22e4f35 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1552 microversion: 2.1 time: 0.153250 Jun 28 03:19:04.858475 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 84/165] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:04 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:05.578523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-37004d75-eac3-4acc-9766-5373ebeb925c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:05.579199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-37004d75-eac3-4acc-9766-5373ebeb925c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:05.588554 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-37004d75-eac3-4acc-9766-5373ebeb925c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:05.589032 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-37004d75-eac3-4acc-9766-5373ebeb925c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:05.590221 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-37004d75-eac3-4acc-9766-5373ebeb925c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:05.591098 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-37004d75-eac3-4acc-9766-5373ebeb925c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:05.742373 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-37004d75-eac3-4acc-9766-5373ebeb925c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:05.752675 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-37004d75-eac3-4acc-9766-5373ebeb925c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1266 microversion: 2.1 time: 0.178263 Jun 28 03:19:05.764907 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 82/166] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:05 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:05.875300 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9b6e0266-9444-4192-b675-7865c85f0f06 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:05.876530 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9b6e0266-9444-4192-b675-7865c85f0f06 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:05.886038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9b6e0266-9444-4192-b675-7865c85f0f06 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:05.888395 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9b6e0266-9444-4192-b675-7865c85f0f06 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:05.889338 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9b6e0266-9444-4192-b675-7865c85f0f06 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:05.889911 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9b6e0266-9444-4192-b675-7865c85f0f06 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:06.030094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9b6e0266-9444-4192-b675-7865c85f0f06 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:06.045965 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-7e1d4f74-b02c-402b-bcdd-f161e00a19a7 req-23fdd1dd-adda-43c9-b3cc-4d3effdeec5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf28320-d40d-457d-8b03-3157d65b8a18", "name": "network-vif-deleted", "tag": "06f883b9-139a-473c-971e-de82ca62f9ab"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:06.047003 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9b6e0266-9444-4192-b675-7865c85f0f06 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1510 microversion: 2.1 time: 0.174773 Jun 28 03:19:06.047623 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 85/167] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:05 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:06.055134 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-7e1d4f74-b02c-402b-bcdd-f161e00a19a7 req-23fdd1dd-adda-43c9-b3cc-4d3effdeec5f service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:06.055777 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-7e1d4f74-b02c-402b-bcdd-f161e00a19a7 req-23fdd1dd-adda-43c9-b3cc-4d3effdeec5f service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:06.067801 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-7e1d4f74-b02c-402b-bcdd-f161e00a19a7 req-23fdd1dd-adda-43c9-b3cc-4d3effdeec5f service nova] Creating event network-vif-deleted:06f883b9-139a-473c-971e-de82ca62f9ab for instance bcf28320-d40d-457d-8b03-3157d65b8a18 on hv-cinder-84684 Jun 28 03:19:06.073459 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-7e1d4f74-b02c-402b-bcdd-f161e00a19a7 req-23fdd1dd-adda-43c9-b3cc-4d3effdeec5f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031859 Jun 28 03:19:06.089055 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 83/168] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:19:06.774641 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8e1b5283-c3aa-46ce-9d55-2bb6ac274119 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:06.775555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8e1b5283-c3aa-46ce-9d55-2bb6ac274119 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:06.784686 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8e1b5283-c3aa-46ce-9d55-2bb6ac274119 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:06.785057 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8e1b5283-c3aa-46ce-9d55-2bb6ac274119 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:06.785811 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8e1b5283-c3aa-46ce-9d55-2bb6ac274119 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:06.786217 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8e1b5283-c3aa-46ce-9d55-2bb6ac274119 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:06.850952 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8e1b5283-c3aa-46ce-9d55-2bb6ac274119 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:06.859053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8e1b5283-c3aa-46ce-9d55-2bb6ac274119 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1274 microversion: 2.1 time: 0.090812 Jun 28 03:19:06.860043 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 86/169] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:06 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:07.066097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-023b9d2f-35c2-4ee6-b973-227093cb19c5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:07.066784 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-023b9d2f-35c2-4ee6-b973-227093cb19c5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:07.073995 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-023b9d2f-35c2-4ee6-b973-227093cb19c5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:07.074413 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-023b9d2f-35c2-4ee6-b973-227093cb19c5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:07.075175 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-023b9d2f-35c2-4ee6-b973-227093cb19c5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:07.075603 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-023b9d2f-35c2-4ee6-b973-227093cb19c5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:07.144104 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-023b9d2f-35c2-4ee6-b973-227093cb19c5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:07.156476 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-023b9d2f-35c2-4ee6-b973-227093cb19c5 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1510 microversion: 2.1 time: 0.091588 Jun 28 03:19:07.156476 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 84/170] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:07 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1510 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:07.876641 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b5ab0359-3bc6-4f45-9320-b27e966f252f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:07.877247 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b5ab0359-3bc6-4f45-9320-b27e966f252f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:07.883425 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b5ab0359-3bc6-4f45-9320-b27e966f252f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:07.884067 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b5ab0359-3bc6-4f45-9320-b27e966f252f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:07.884844 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b5ab0359-3bc6-4f45-9320-b27e966f252f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:07.885268 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b5ab0359-3bc6-4f45-9320-b27e966f252f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:07.950287 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b5ab0359-3bc6-4f45-9320-b27e966f252f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:07.958121 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b5ab0359-3bc6-4f45-9320-b27e966f252f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1274 microversion: 2.1 time: 0.085376 Jun 28 03:19:07.958680 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 87/171] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:07 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:08.170325 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a8639ae8-8f44-41cf-877f-41d47c3f2203 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:08.170923 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a8639ae8-8f44-41cf-877f-41d47c3f2203 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:08.177796 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a8639ae8-8f44-41cf-877f-41d47c3f2203 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:08.178235 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a8639ae8-8f44-41cf-877f-41d47c3f2203 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:08.178978 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a8639ae8-8f44-41cf-877f-41d47c3f2203 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:08.179399 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a8639ae8-8f44-41cf-877f-41d47c3f2203 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:08.242854 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a8639ae8-8f44-41cf-877f-41d47c3f2203 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:08.251259 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a8639ae8-8f44-41cf-877f-41d47c3f2203 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1510 microversion: 2.1 time: 0.084863 Jun 28 03:19:08.252289 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 85/172] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:08 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1510 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:08.974881 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b488469d-6b35-4bff-8069-c9c2ffe48e86 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:08.975478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b488469d-6b35-4bff-8069-c9c2ffe48e86 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:08.982591 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b488469d-6b35-4bff-8069-c9c2ffe48e86 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:08.983028 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b488469d-6b35-4bff-8069-c9c2ffe48e86 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:08.983815 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b488469d-6b35-4bff-8069-c9c2ffe48e86 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:08.984333 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b488469d-6b35-4bff-8069-c9c2ffe48e86 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:09.062406 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b488469d-6b35-4bff-8069-c9c2ffe48e86 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:09.069868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b488469d-6b35-4bff-8069-c9c2ffe48e86 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1272 microversion: 2.1 time: 0.098853 Jun 28 03:19:09.070428 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 88/173] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:08 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:19:09.268178 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-995cf990-0215-49a3-88ee-984dbd8a05d4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:09.268749 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-995cf990-0215-49a3-88ee-984dbd8a05d4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:09.275921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-995cf990-0215-49a3-88ee-984dbd8a05d4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:09.276413 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-995cf990-0215-49a3-88ee-984dbd8a05d4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:09.277170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-995cf990-0215-49a3-88ee-984dbd8a05d4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:09.277638 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-995cf990-0215-49a3-88ee-984dbd8a05d4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:09.355104 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-995cf990-0215-49a3-88ee-984dbd8a05d4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ee1c7fa1b03406bb4ff6395ca977aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43bb7fc15b254d9f877373131c37923c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:09.367389 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-995cf990-0215-49a3-88ee-984dbd8a05d4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 200 len: 1345 microversion: 2.1 time: 0.103126 Jun 28 03:19:09.367975 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 86/174] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:09 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 1345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:09.971991 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-bb03b385-ddff-4baf-a668-3e3622138476 req-a7b1c9ac-0d9d-4d46-8ad6-0a4668f27979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee00cc9-d66c-4a54-bf4c-9aff3a37f653", "tag": "eed5a55e-f288-4b02-b7ab-d307cbfe0a94"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:09.986773 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bb03b385-ddff-4baf-a668-3e3622138476 req-a7b1c9ac-0d9d-4d46-8ad6-0a4668f27979 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:09.987548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bb03b385-ddff-4baf-a668-3e3622138476 req-a7b1c9ac-0d9d-4d46-8ad6-0a4668f27979 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:10.005167 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-bb03b385-ddff-4baf-a668-3e3622138476 req-a7b1c9ac-0d9d-4d46-8ad6-0a4668f27979 service nova] Creating event network-changed:eed5a55e-f288-4b02-b7ab-d307cbfe0a94 for instance 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 on hv-cinder-84684 Jun 28 03:19:10.010784 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-bb03b385-ddff-4baf-a668-3e3622138476 req-a7b1c9ac-0d9d-4d46-8ad6-0a4668f27979 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042178 Jun 28 03:19:10.011495 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 89/175] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:19:10.087559 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-732e1ddd-eb55-4923-98b7-263238fdee85 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:10.088472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-732e1ddd-eb55-4923-98b7-263238fdee85 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:10.097082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-732e1ddd-eb55-4923-98b7-263238fdee85 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:10.097516 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-732e1ddd-eb55-4923-98b7-263238fdee85 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:10.098762 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-732e1ddd-eb55-4923-98b7-263238fdee85 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:10.098920 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-732e1ddd-eb55-4923-98b7-263238fdee85 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:10.345928 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-732e1ddd-eb55-4923-98b7-263238fdee85 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:10.354994 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-732e1ddd-eb55-4923-98b7-263238fdee85 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1314 microversion: 2.1 time: 0.271844 Jun 28 03:19:10.355733 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 87/176] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:10 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:10.386742 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-39a83441-8c43-42ff-8479-dfb000d85cb0 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:10.387468 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-39a83441-8c43-42ff-8479-dfb000d85cb0 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:10.393730 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-39a83441-8c43-42ff-8479-dfb000d85cb0 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:10.394157 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-39a83441-8c43-42ff-8479-dfb000d85cb0 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:10.394915 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-39a83441-8c43-42ff-8479-dfb000d85cb0 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:10.395343 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-39a83441-8c43-42ff-8479-dfb000d85cb0 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:10.418927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-39a83441-8c43-42ff-8479-dfb000d85cb0 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] HTTP exception thrown: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-39a83441-8c43-42ff-8479-dfb000d85cb0 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Request method failure captured: Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 HTTP/1.1 Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunLjJWRlP1U04FKZPNgu70PZqNNycGr3dnyGKN7-LXFQWPONMt91WQBWeGoFhRZSDFKXqJXBOIjPR7RsSq3prLLU0tTaC81SLHb29ubwtfJOemSouHrAr3_46I2aEPZwXKoGj0pjwaK33qeWtMpZ5Re3h3UGdH_a2R91jUV8LmlFYVg Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 43bb7fc15b254d9f877373131c37923c Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-DeleteServersTestJSON-1476345491 Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:19:10.423748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:19:10.425302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_43bb7fc15b254d9f877373131c37923c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/43bb7fc15b254d9f877373131c37923c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/43bb7fc15b254d9f877373131c37923c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/43bb7fc15b254d9f877373131c37923c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:19:10.425302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-DeleteServersTestJSON-1476345491 Jun 28 03:19:10.425302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 43bb7fc15b254d9f877373131c37923c Jun 28 03:19:10.425302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-DeleteServersTestJSON-1476345491 Jun 28 03:19:10.425302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-DeleteServersTestJSON-1476345491-project Jun 28 03:19:10.425302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:19:10.425302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:19:10.425302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 4ee1c7fa1b03406bb4ff6395ca977aad Jun 28 03:19:10.425302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-DeleteServersTestJSON-1476345491-project Jun 28 03:19:10.425302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:19:10.425302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:10.425302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': 'bcf28320-d40d-457d-8b03-3157d65b8a18'} Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:19:10.426370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:10.427910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:10.429389 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-39a83441-8c43-42ff-8479-dfb000d85cb0 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Returning 404 to user: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:19:10.429389 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-39a83441-8c43-42ff-8479-dfb000d85cb0 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 404 len: 111 microversion: 2.1 time: 0.043389 Jun 28 03:19:10.429389 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 90/177] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:10 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:19:10.537698 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f9b44d09-1e76-4b7a-aee3-a1ec1fe9ce10 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:10.538622 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f9b44d09-1e76-4b7a-aee3-a1ec1fe9ce10 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:10.545166 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f9b44d09-1e76-4b7a-aee3-a1ec1fe9ce10 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:10.545589 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f9b44d09-1e76-4b7a-aee3-a1ec1fe9ce10 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:10.546546 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f9b44d09-1e76-4b7a-aee3-a1ec1fe9ce10 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:10.546963 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f9b44d09-1e76-4b7a-aee3-a1ec1fe9ce10 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:10.560538 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-f9b44d09-1e76-4b7a-aee3-a1ec1fe9ce10 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] HTTP exception thrown: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f9b44d09-1e76-4b7a-aee3-a1ec1fe9ce10 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Request method failure captured: Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18/os-volume_attachments HTTP/1.1 Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLjJWRlP1U04FKZPNgu70PZqNNycGr3dnyGKN7-LXFQWPONMt91WQBWeGoFhRZSDFKXqJXBOIjPR7RsSq3prLLU0tTaC81SLHb29ubwtfJOemSouHrAr3_46I2aEPZwXKoGj0pjwaK33qeWtMpZ5Re3h3UGdH_a2R91jUV8LmlFYVg Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 43bb7fc15b254d9f877373131c37923c Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-DeleteServersTestJSON-1476345491 Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:19:10.564831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:19:10.566310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_43bb7fc15b254d9f877373131c37923c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/43bb7fc15b254d9f877373131c37923c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/43bb7fc15b254d9f877373131c37923c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/43bb7fc15b254d9f877373131c37923c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:19:10.566310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-DeleteServersTestJSON-1476345491 Jun 28 03:19:10.566310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 43bb7fc15b254d9f877373131c37923c Jun 28 03:19:10.566310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-DeleteServersTestJSON-1476345491 Jun 28 03:19:10.566310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-DeleteServersTestJSON-1476345491-project Jun 28 03:19:10.566310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:19:10.566310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:19:10.566310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4ee1c7fa1b03406bb4ff6395ca977aad Jun 28 03:19:10.566310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-DeleteServersTestJSON-1476345491-project Jun 28 03:19:10.566310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:19:10.566310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:10.566310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'server_id': 'bcf28320-d40d-457d-8b03-3157d65b8a18'} Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:19:10.567035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:10.568668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:10.569879 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f9b44d09-1e76-4b7a-aee3-a1ec1fe9ce10 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Returning 404 to user: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:19:10.569879 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f9b44d09-1e76-4b7a-aee3-a1ec1fe9ce10 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032711 Jun 28 03:19:10.569879 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 88/178] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:19:10 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 03:19:11.372916 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2e362c4c-8ce6-4a13-82f9-4f1dddfc3138 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:11.373625 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2e362c4c-8ce6-4a13-82f9-4f1dddfc3138 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:11.380353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2e362c4c-8ce6-4a13-82f9-4f1dddfc3138 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:11.380798 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2e362c4c-8ce6-4a13-82f9-4f1dddfc3138 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:11.381680 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2e362c4c-8ce6-4a13-82f9-4f1dddfc3138 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:11.382325 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2e362c4c-8ce6-4a13-82f9-4f1dddfc3138 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:11.537645 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2e362c4c-8ce6-4a13-82f9-4f1dddfc3138 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:11.546433 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2e362c4c-8ce6-4a13-82f9-4f1dddfc3138 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1314 microversion: 2.1 time: 0.177983 Jun 28 03:19:11.554941 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 91/179] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:11 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:11.819087 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-85fb5e75-3f72-4c87-bece-27d28df83bcd tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:11.819600 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-85fb5e75-3f72-4c87-bece-27d28df83bcd tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:11.827185 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-85fb5e75-3f72-4c87-bece-27d28df83bcd tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:11.827610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-85fb5e75-3f72-4c87-bece-27d28df83bcd tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:11.828399 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-85fb5e75-3f72-4c87-bece-27d28df83bcd tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:11.828897 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-85fb5e75-3f72-4c87-bece-27d28df83bcd tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:11.843092 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-85fb5e75-3f72-4c87-bece-27d28df83bcd tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] HTTP exception thrown: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-85fb5e75-3f72-4c87-bece-27d28df83bcd tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Request method failure captured: Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: DELETE /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 HTTP/1.1 Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLjJWRlP1U04FKZPNgu70PZqNNycGr3dnyGKN7-LXFQWPONMt91WQBWeGoFhRZSDFKXqJXBOIjPR7RsSq3prLLU0tTaC81SLHb29ubwtfJOemSouHrAr3_46I2aEPZwXKoGj0pjwaK33qeWtMpZ5Re3h3UGdH_a2R91jUV8LmlFYVg Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 43bb7fc15b254d9f877373131c37923c Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-DeleteServersTestJSON-1476345491 Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:19:11.845274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:19:11.846418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_43bb7fc15b254d9f877373131c37923c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/43bb7fc15b254d9f877373131c37923c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/43bb7fc15b254d9f877373131c37923c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/43bb7fc15b254d9f877373131c37923c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:19:11.846418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-DeleteServersTestJSON-1476345491 Jun 28 03:19:11.846418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 43bb7fc15b254d9f877373131c37923c Jun 28 03:19:11.846418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-DeleteServersTestJSON-1476345491 Jun 28 03:19:11.846418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-DeleteServersTestJSON-1476345491-project Jun 28 03:19:11.846418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:19:11.846418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:19:11.846418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4ee1c7fa1b03406bb4ff6395ca977aad Jun 28 03:19:11.846418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-DeleteServersTestJSON-1476345491-project Jun 28 03:19:11.846418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:19:11.846418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:11.846418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': 'bcf28320-d40d-457d-8b03-3157d65b8a18'} Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:19:11.847316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:11.848361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:11.849527 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-85fb5e75-3f72-4c87-bece-27d28df83bcd tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Returning 404 to user: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:19:11.849527 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-85fb5e75-3f72-4c87-bece-27d28df83bcd tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 404 len: 111 microversion: 2.1 time: 0.031419 Jun 28 03:19:11.849527 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 89/180] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:19:11 2022] DELETE /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:19:11.855247 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-33e5f42a-377c-4784-bb2a-9fde34c173e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:11.855849 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-33e5f42a-377c-4784-bb2a-9fde34c173e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] [instance: bcf28320-d40d-457d-8b03-3157d65b8a18] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:11.862705 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-33e5f42a-377c-4784-bb2a-9fde34c173e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:11.863225 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-33e5f42a-377c-4784-bb2a-9fde34c173e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:11.864306 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-33e5f42a-377c-4784-bb2a-9fde34c173e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:11.864927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-33e5f42a-377c-4784-bb2a-9fde34c173e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:11.878784 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-33e5f42a-377c-4784-bb2a-9fde34c173e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] HTTP exception thrown: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-33e5f42a-377c-4784-bb2a-9fde34c173e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Request method failure captured: Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 HTTP/1.1 Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunLjJWRlP1U04FKZPNgu70PZqNNycGr3dnyGKN7-LXFQWPONMt91WQBWeGoFhRZSDFKXqJXBOIjPR7RsSq3prLLU0tTaC81SLHb29ubwtfJOemSouHrAr3_46I2aEPZwXKoGj0pjwaK33qeWtMpZ5Re3h3UGdH_a2R91jUV8LmlFYVg Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 43bb7fc15b254d9f877373131c37923c Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-DeleteServersTestJSON-1476345491 Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:19:11.880327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:19:11.881690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_43bb7fc15b254d9f877373131c37923c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/43bb7fc15b254d9f877373131c37923c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/43bb7fc15b254d9f877373131c37923c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/43bb7fc15b254d9f877373131c37923c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:19:11.881690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-DeleteServersTestJSON-1476345491 Jun 28 03:19:11.881690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 43bb7fc15b254d9f877373131c37923c Jun 28 03:19:11.881690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-DeleteServersTestJSON-1476345491 Jun 28 03:19:11.881690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-DeleteServersTestJSON-1476345491-project Jun 28 03:19:11.881690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:19:11.881690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:19:11.881690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 4ee1c7fa1b03406bb4ff6395ca977aad Jun 28 03:19:11.881690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-DeleteServersTestJSON-1476345491-project Jun 28 03:19:11.881690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:19:11.881690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:11.881690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': 'bcf28320-d40d-457d-8b03-3157d65b8a18'} Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:19:11.882447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. Jun 28 03:19:11.883741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:11.885787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-33e5f42a-377c-4784-bb2a-9fde34c173e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] Returning 404 to user: Instance bcf28320-d40d-457d-8b03-3157d65b8a18 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:19:11.887113 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-33e5f42a-377c-4784-bb2a-9fde34c173e4 tempest-DeleteServersTestJSON-1476345491 tempest-DeleteServersTestJSON-1476345491-project] 10.222.0.44 "GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18" status: 404 len: 111 microversion: 2.1 time: 0.035772 Jun 28 03:19:11.887741 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 92/181] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:11 2022] GET /compute/v2.1/servers/bcf28320-d40d-457d-8b03-3157d65b8a18 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:19:12.563215 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-65af2198-50c0-4472-b8de-fcf50c515bc4 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:12.563871 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-65af2198-50c0-4472-b8de-fcf50c515bc4 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:12.570291 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-65af2198-50c0-4472-b8de-fcf50c515bc4 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:12.570798 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-65af2198-50c0-4472-b8de-fcf50c515bc4 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:12.572188 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-65af2198-50c0-4472-b8de-fcf50c515bc4 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:12.572771 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-65af2198-50c0-4472-b8de-fcf50c515bc4 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:12.773695 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-65af2198-50c0-4472-b8de-fcf50c515bc4 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:12.783848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-65af2198-50c0-4472-b8de-fcf50c515bc4 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1314 microversion: 2.1 time: 0.224791 Jun 28 03:19:12.785134 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 90/182] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:12 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:13.801166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a59fba4b-59b0-441e-ad77-027a4be44069 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:13.801763 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a59fba4b-59b0-441e-ad77-027a4be44069 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:13.803909 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:13.804773 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:13.810796 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a59fba4b-59b0-441e-ad77-027a4be44069 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:13.811478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a59fba4b-59b0-441e-ad77-027a4be44069 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:13.812271 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a59fba4b-59b0-441e-ad77-027a4be44069 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:13.812699 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a59fba4b-59b0-441e-ad77-027a4be44069 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:14.031978 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a59fba4b-59b0-441e-ad77-027a4be44069 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:14.055064 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a59fba4b-59b0-441e-ad77-027a4be44069 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1314 microversion: 2.1 time: 0.242667 Jun 28 03:19:14.057745 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 93/183] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:13 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:15.073691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ae4d7034-5189-41a5-83ac-6201855b63a5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:15.074272 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ae4d7034-5189-41a5-83ac-6201855b63a5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:15.081921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:15.084718 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ae4d7034-5189-41a5-83ac-6201855b63a5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:15.085584 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ae4d7034-5189-41a5-83ac-6201855b63a5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:15.086684 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ae4d7034-5189-41a5-83ac-6201855b63a5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:15.087256 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ae4d7034-5189-41a5-83ac-6201855b63a5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:15.293557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ae4d7034-5189-41a5-83ac-6201855b63a5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:15.302487 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ae4d7034-5189-41a5-83ac-6201855b63a5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1314 microversion: 2.1 time: 0.232453 Jun 28 03:19:15.303063 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 91/184] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:15 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:16.325344 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-02f99372-40bc-470c-9b0c-9c6218159e1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:16.326635 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-02f99372-40bc-470c-9b0c-9c6218159e1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:16.336689 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02f99372-40bc-470c-9b0c-9c6218159e1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:16.337556 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02f99372-40bc-470c-9b0c-9c6218159e1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:16.338511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02f99372-40bc-470c-9b0c-9c6218159e1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:16.339132 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02f99372-40bc-470c-9b0c-9c6218159e1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:16.588710 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-02f99372-40bc-470c-9b0c-9c6218159e1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:16.625530 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-02f99372-40bc-470c-9b0c-9c6218159e1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1314 microversion: 2.1 time: 0.307965 Jun 28 03:19:16.630270 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 94/185] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:16 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:16.903207 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-7007d147-2bb5-4874-8b2f-bc5b6aaa75a3 req-d6257635-db0a-4bb2-98eb-4b3c91668414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee00cc9-d66c-4a54-bf4c-9aff3a37f653", "name": "network-vif-plugged", "status": "completed", "tag": "eed5a55e-f288-4b02-b7ab-d307cbfe0a94"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:16.916020 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-7007d147-2bb5-4874-8b2f-bc5b6aaa75a3 req-d6257635-db0a-4bb2-98eb-4b3c91668414 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:16.916490 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-7007d147-2bb5-4874-8b2f-bc5b6aaa75a3 req-d6257635-db0a-4bb2-98eb-4b3c91668414 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:16.931432 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-7007d147-2bb5-4874-8b2f-bc5b6aaa75a3 req-d6257635-db0a-4bb2-98eb-4b3c91668414 service nova] Creating event network-vif-plugged:eed5a55e-f288-4b02-b7ab-d307cbfe0a94 for instance 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 on hv-cinder-84684 Jun 28 03:19:16.938720 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-7007d147-2bb5-4874-8b2f-bc5b6aaa75a3 req-d6257635-db0a-4bb2-98eb-4b3c91668414 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044937 Jun 28 03:19:16.940891 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 92/186] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:19:17.647415 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d1c2ff57-e590-4668-9438-c19fe00b49b5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:17.648188 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d1c2ff57-e590-4668-9438-c19fe00b49b5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:17.655205 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d1c2ff57-e590-4668-9438-c19fe00b49b5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:17.655719 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d1c2ff57-e590-4668-9438-c19fe00b49b5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:17.656676 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d1c2ff57-e590-4668-9438-c19fe00b49b5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:17.657194 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d1c2ff57-e590-4668-9438-c19fe00b49b5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:17.800411 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d1c2ff57-e590-4668-9438-c19fe00b49b5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:17.813998 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d1c2ff57-e590-4668-9438-c19fe00b49b5 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1314 microversion: 2.1 time: 0.170795 Jun 28 03:19:17.821422 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 95/187] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:17 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:18.833540 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b1a4beca-5886-4239-876c-161d5a7d2452 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:18.834863 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b1a4beca-5886-4239-876c-161d5a7d2452 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:18.844281 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b1a4beca-5886-4239-876c-161d5a7d2452 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:18.844876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b1a4beca-5886-4239-876c-161d5a7d2452 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:18.845808 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b1a4beca-5886-4239-876c-161d5a7d2452 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:18.846504 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b1a4beca-5886-4239-876c-161d5a7d2452 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:19.105852 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b1a4beca-5886-4239-876c-161d5a7d2452 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:19.116131 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b1a4beca-5886-4239-876c-161d5a7d2452 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1314 microversion: 2.1 time: 0.288173 Jun 28 03:19:19.117387 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 93/188] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:18 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:20.134355 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0153d483-3d06-4523-ae77-8ae820d10810 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:20.135525 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0153d483-3d06-4523-ae77-8ae820d10810 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:20.145133 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0153d483-3d06-4523-ae77-8ae820d10810 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:20.145846 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0153d483-3d06-4523-ae77-8ae820d10810 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:20.146992 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0153d483-3d06-4523-ae77-8ae820d10810 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:20.147570 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0153d483-3d06-4523-ae77-8ae820d10810 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:20.184382 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=87 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:20.570719 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0153d483-3d06-4523-ae77-8ae820d10810 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:20.586116 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0153d483-3d06-4523-ae77-8ae820d10810 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1314 microversion: 2.1 time: 0.454488 Jun 28 03:19:20.603851 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 96/189] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:20 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:21.067666 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1477259011", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452"}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:21.157830 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.network.neutron [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] validate_networks() for None {{(pid=117681) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:19:21.610702 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b8199404-689f-44ce-a56f-b664c229b708 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:21.620493 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b8199404-689f-44ce-a56f-b664c229b708 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:21.647217 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b8199404-689f-44ce-a56f-b664c229b708 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:21.650426 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b8199404-689f-44ce-a56f-b664c229b708 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:21.651940 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b8199404-689f-44ce-a56f-b664c229b708 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:21.652810 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b8199404-689f-44ce-a56f-b664c229b708 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:21.875801 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Flavor limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:19:21.876279 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Image limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:19:21.876821 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Flavor pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:19:21.877229 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Image pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:19:21.877645 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:19:21.906762 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:21.907414 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:21.908432 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:21.909055 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:21.933906 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:21.952716 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Getting quotas for project 0d5bf71f605c4d65af4829f5e403a2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:19:21.966912 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Getting quotas for user 2081ae8cb02e4a62b716c58aa2ed1ac1 and project 0d5bf71f605c4d65af4829f5e403a2a7. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:19:22.005603 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Going to run 1 instances... {{(pid=117681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:19:22.008049 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:19:22.122723 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f9c7ed30-23a6-40c2-b278-69c9718b0652 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.056331 Jun 28 03:19:22.141467 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 94/190] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:19:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:19:22.166564 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b8199404-689f-44ce-a56f-b664c229b708 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:22.170661 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7bccd39d-61d0-4ffb-b54d-8482776d9084 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:22.171291 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7bccd39d-61d0-4ffb-b54d-8482776d9084 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:22.197406 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b8199404-689f-44ce-a56f-b664c229b708 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1314 microversion: 2.1 time: 0.589835 Jun 28 03:19:22.207214 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 97/191] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:21 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:22.358694 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7bccd39d-61d0-4ffb-b54d-8482776d9084 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:22.369949 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7bccd39d-61d0-4ffb-b54d-8482776d9084 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1215 microversion: 2.1 time: 0.227260 Jun 28 03:19:22.370527 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 95/192] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:22 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1215 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:23.215215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1012dbfd-3eca-4f92-9660-06bff157d5d3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:23.216609 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1012dbfd-3eca-4f92-9660-06bff157d5d3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:23.229008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1012dbfd-3eca-4f92-9660-06bff157d5d3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:23.231729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1012dbfd-3eca-4f92-9660-06bff157d5d3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:23.234565 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1012dbfd-3eca-4f92-9660-06bff157d5d3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:23.237934 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1012dbfd-3eca-4f92-9660-06bff157d5d3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:23.387384 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ded59d2b-329e-4124-a81e-966cf7d96c00 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:23.388779 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ded59d2b-329e-4124-a81e-966cf7d96c00 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:23.401099 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ded59d2b-329e-4124-a81e-966cf7d96c00 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:23.401888 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ded59d2b-329e-4124-a81e-966cf7d96c00 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:23.404760 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ded59d2b-329e-4124-a81e-966cf7d96c00 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:23.405541 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ded59d2b-329e-4124-a81e-966cf7d96c00 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:23.666559 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ded59d2b-329e-4124-a81e-966cf7d96c00 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:23.683094 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ded59d2b-329e-4124-a81e-966cf7d96c00 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1211 microversion: 2.1 time: 0.294457 Jun 28 03:19:23.684949 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 96/193] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:23 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1211 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:23.901088 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1012dbfd-3eca-4f92-9660-06bff157d5d3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:23.916973 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1012dbfd-3eca-4f92-9660-06bff157d5d3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1498 microversion: 2.1 time: 0.705658 Jun 28 03:19:23.920816 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 98/194] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:23 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1498 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:24.702267 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8c4bbd37-800b-4673-8503-8ed87f458403 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:24.704666 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-8c4bbd37-800b-4673-8503-8ed87f458403 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:24.717785 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c4bbd37-800b-4673-8503-8ed87f458403 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:24.718505 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c4bbd37-800b-4673-8503-8ed87f458403 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:24.721312 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c4bbd37-800b-4673-8503-8ed87f458403 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:24.723452 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c4bbd37-800b-4673-8503-8ed87f458403 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:25.296962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-8c4bbd37-800b-4673-8503-8ed87f458403 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:25.308190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-8c4bbd37-800b-4673-8503-8ed87f458403 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1211 microversion: 2.1 time: 0.607166 Jun 28 03:19:25.310100 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 97/195] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:24 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1211 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:26.082165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2084074694", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:26.150944 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] validate_networks() for [('9da7fe3f-1d18-4c0b-9bbc-ebc663cd4b3d', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:19:26.327927 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f3ac73f9-f2ac-4c09-b450-86ce8ddf205f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:26.329360 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f3ac73f9-f2ac-4c09-b450-86ce8ddf205f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:26.345640 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f3ac73f9-f2ac-4c09-b450-86ce8ddf205f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:26.346089 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f3ac73f9-f2ac-4c09-b450-86ce8ddf205f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:26.351897 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f3ac73f9-f2ac-4c09-b450-86ce8ddf205f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:26.352421 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f3ac73f9-f2ac-4c09-b450-86ce8ddf205f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:26.591524 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-f3ac73f9-f2ac-4c09-b450-86ce8ddf205f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:26.602914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f3ac73f9-f2ac-4c09-b450-86ce8ddf205f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1267 microversion: 2.1 time: 0.281401 Jun 28 03:19:26.603507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 98/196] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:26 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1267 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:26.618542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-638b9f2c-e91d-4086-bd31-59c36d50bf2b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:26.619059 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-638b9f2c-e91d-4086-bd31-59c36d50bf2b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:26.638793 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-638b9f2c-e91d-4086-bd31-59c36d50bf2b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:26.639246 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-638b9f2c-e91d-4086-bd31-59c36d50bf2b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:26.640030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-638b9f2c-e91d-4086-bd31-59c36d50bf2b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:26.657672 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-638b9f2c-e91d-4086-bd31-59c36d50bf2b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:26.788282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-638b9f2c-e91d-4086-bd31-59c36d50bf2b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Going to try to terminate instance {{(pid=117681) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:19:26.960257 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-638b9f2c-e91d-4086-bd31-59c36d50bf2b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 204 len: 0 microversion: 2.1 time: 0.348104 Jun 28 03:19:26.963956 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 99/197] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:19:26 2022] DELETE /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:19:26.977361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f5ab09a9-25aa-4745-8436-08b39228b2a8 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:26.978804 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f5ab09a9-25aa-4745-8436-08b39228b2a8 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:26.997300 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f5ab09a9-25aa-4745-8436-08b39228b2a8 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:26.998180 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f5ab09a9-25aa-4745-8436-08b39228b2a8 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:27.002342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f5ab09a9-25aa-4745-8436-08b39228b2a8 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:27.002783 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f5ab09a9-25aa-4745-8436-08b39228b2a8 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:27.324441 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:19:27.325585 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:19:27.326225 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:19:27.326968 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:19:27.327605 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:19:27.364755 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:27.365507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:27.366885 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:27.368309 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:27.383165 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-f5ab09a9-25aa-4745-8436-08b39228b2a8 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:27.408224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f5ab09a9-25aa-4745-8436-08b39228b2a8 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1504 microversion: 2.1 time: 0.428365 Jun 28 03:19:27.408224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 100/198] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:26 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:19:27.410466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Getting quotas for project c1e596746cc64a1981804d95f1906bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:19:27.421875 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Getting quotas for user facb00bcd5644550a93901791f77b89c and project c1e596746cc64a1981804d95f1906bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:19:27.451925 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:19:27.459221 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:19:27.560880 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0f203ec4-a86c-4eb2-a136-dd0e1a2ab19c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.762995 Jun 28 03:19:27.561609 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 99/199] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:19:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:19:27.571942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-50716361-9eec-4fa0-964c-b00cd22ec165 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:27.572609 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-50716361-9eec-4fa0-964c-b00cd22ec165 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:27.626072 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3062a1cd-fd21-40c2-8946-9f81d5fce7f2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:27.626737 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3062a1cd-fd21-40c2-8946-9f81d5fce7f2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:27.650771 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3062a1cd-fd21-40c2-8946-9f81d5fce7f2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:27.651212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3062a1cd-fd21-40c2-8946-9f81d5fce7f2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:27.652000 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3062a1cd-fd21-40c2-8946-9f81d5fce7f2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:27.652571 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3062a1cd-fd21-40c2-8946-9f81d5fce7f2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:27.712274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-50716361-9eec-4fa0-964c-b00cd22ec165 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:27.728818 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-50716361-9eec-4fa0-964c-b00cd22ec165 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1222 microversion: 2.1 time: 0.156346 Jun 28 03:19:27.729785 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 101/200] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:27 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:27.824513 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3062a1cd-fd21-40c2-8946-9f81d5fce7f2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:27.850271 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3062a1cd-fd21-40c2-8946-9f81d5fce7f2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1273 microversion: 2.1 time: 0.228086 Jun 28 03:19:27.855476 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 100/201] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:27 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1273 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:27.905027 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-500877245", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:27.988622 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.network.neutron [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] validate_networks() for [('9da7fe3f-1d18-4c0b-9bbc-ebc663cd4b3d', None, None, None, None, None)] {{(pid=117681) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:19:28.419534 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-138b0d95-4000-449c-a4fe-570026223421 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:28.421836 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-138b0d95-4000-449c-a4fe-570026223421 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:28.430430 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-138b0d95-4000-449c-a4fe-570026223421 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:28.435017 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-138b0d95-4000-449c-a4fe-570026223421 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:28.436014 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-138b0d95-4000-449c-a4fe-570026223421 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:28.448259 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-138b0d95-4000-449c-a4fe-570026223421 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:29.051646 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-138b0d95-4000-449c-a4fe-570026223421 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:29.064833 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-138b0d95-4000-449c-a4fe-570026223421 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1504 microversion: 2.1 time: 0.649674 Jun 28 03:19:29.066130 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 101/202] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:28 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1504 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:29.079807 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7c1429eb-694c-45ce-9a51-d0495f41bf27 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:29.081036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7c1429eb-694c-45ce-9a51-d0495f41bf27 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:29.090711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:29.093093 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7c1429eb-694c-45ce-9a51-d0495f41bf27 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:29.095455 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7c1429eb-694c-45ce-9a51-d0495f41bf27 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:29.096539 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7c1429eb-694c-45ce-9a51-d0495f41bf27 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:29.108918 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7c1429eb-694c-45ce-9a51-d0495f41bf27 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:29.448460 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7c1429eb-694c-45ce-9a51-d0495f41bf27 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:29.464428 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7c1429eb-694c-45ce-9a51-d0495f41bf27 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1273 microversion: 2.1 time: 0.390890 Jun 28 03:19:29.466490 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 102/203] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:29 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1273 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:29.659632 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Flavor limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:19:29.660199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Image limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:19:29.660698 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Flavor pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:19:29.661282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Image pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:19:29.661957 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:19:29.692267 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:29.719619 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:29.723113 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:29.726607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:29.728680 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:29.793422 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Getting quotas for project c1e596746cc64a1981804d95f1906bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:19:29.802374 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Getting quotas for user facb00bcd5644550a93901791f77b89c and project c1e596746cc64a1981804d95f1906bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:19:29.840942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Going to run 1 instances... {{(pid=117681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:19:29.843479 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:19:29.951992 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d75d37ae-753f-4f02-884a-fabcf1314a45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.052482 Jun 28 03:19:29.955034 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 102/204] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:19:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 2056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:19:29.970116 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7c6c6514-933e-4658-a1a0-c0e5beaf72c5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:29.970732 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7c6c6514-933e-4658-a1a0-c0e5beaf72c5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:30.084360 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-0ffdb1a0-3cca-43e8-bf9c-c2109f2bed4e tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:30.085159 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-0ffdb1a0-3cca-43e8-bf9c-c2109f2bed4e tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:30.097012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0ffdb1a0-3cca-43e8-bf9c-c2109f2bed4e tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:30.099532 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0ffdb1a0-3cca-43e8-bf9c-c2109f2bed4e tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:30.100559 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0ffdb1a0-3cca-43e8-bf9c-c2109f2bed4e tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:30.103193 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0ffdb1a0-3cca-43e8-bf9c-c2109f2bed4e tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:30.112477 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7c6c6514-933e-4658-a1a0-c0e5beaf72c5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:30.124214 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7c6c6514-933e-4658-a1a0-c0e5beaf72c5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1221 microversion: 2.1 time: 0.162044 Jun 28 03:19:30.141946 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 103/205] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:29 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1221 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:30.435435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-0ffdb1a0-3cca-43e8-bf9c-c2109f2bed4e tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:30.463902 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-0ffdb1a0-3cca-43e8-bf9c-c2109f2bed4e tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1504 microversion: 2.1 time: 0.383293 Jun 28 03:19:30.465206 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 103/206] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:30 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1504 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:30.485435 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b62e3647-0ac3-4ff5-b6fa-ab62a59ac5ac tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:30.486611 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b62e3647-0ac3-4ff5-b6fa-ab62a59ac5ac tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:30.499501 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b62e3647-0ac3-4ff5-b6fa-ab62a59ac5ac tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:30.500109 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b62e3647-0ac3-4ff5-b6fa-ab62a59ac5ac tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:30.504931 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b62e3647-0ac3-4ff5-b6fa-ab62a59ac5ac tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:30.505552 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b62e3647-0ac3-4ff5-b6fa-ab62a59ac5ac tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:31.151309 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e633c896-1bb3-494c-ad0b-defd338cb58a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:31.153300 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e633c896-1bb3-494c-ad0b-defd338cb58a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:31.171513 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e633c896-1bb3-494c-ad0b-defd338cb58a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:31.171976 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e633c896-1bb3-494c-ad0b-defd338cb58a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:31.172829 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e633c896-1bb3-494c-ad0b-defd338cb58a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:31.179671 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e633c896-1bb3-494c-ad0b-defd338cb58a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:31.448275 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b62e3647-0ac3-4ff5-b6fa-ab62a59ac5ac tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:31.461808 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b62e3647-0ac3-4ff5-b6fa-ab62a59ac5ac tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1315 microversion: 2.1 time: 0.982877 Jun 28 03:19:31.463548 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e633c896-1bb3-494c-ad0b-defd338cb58a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:31.463787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 104/207] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:30 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1315 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:31.472426 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e633c896-1bb3-494c-ad0b-defd338cb58a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1217 microversion: 2.1 time: 0.327986 Jun 28 03:19:31.472995 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 104/208] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:31 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1217 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:19:31.494591 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4b563012-1bcd-43d8-a6ff-da4f7e39cd67 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:31.496124 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4b563012-1bcd-43d8-a6ff-da4f7e39cd67 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:31.506360 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4b563012-1bcd-43d8-a6ff-da4f7e39cd67 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:31.506846 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-7babf914-d0d8-4135-a8c0-07618ff8cae2 req-3253d438-db40-432d-bb2b-7c4c9ee27d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee00cc9-d66c-4a54-bf4c-9aff3a37f653", "name": "network-vif-deleted", "tag": "eed5a55e-f288-4b02-b7ab-d307cbfe0a94"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:31.507215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4b563012-1bcd-43d8-a6ff-da4f7e39cd67 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:31.508824 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4b563012-1bcd-43d8-a6ff-da4f7e39cd67 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:31.509471 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4b563012-1bcd-43d8-a6ff-da4f7e39cd67 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:31.521683 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-7babf914-d0d8-4135-a8c0-07618ff8cae2 req-3253d438-db40-432d-bb2b-7c4c9ee27d04 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:31.526006 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-7babf914-d0d8-4135-a8c0-07618ff8cae2 req-3253d438-db40-432d-bb2b-7c4c9ee27d04 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:31.560331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-7babf914-d0d8-4135-a8c0-07618ff8cae2 req-3253d438-db40-432d-bb2b-7c4c9ee27d04 service nova] Creating event network-vif-deleted:eed5a55e-f288-4b02-b7ab-d307cbfe0a94 for instance 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 on hv-cinder-84684 Jun 28 03:19:31.574988 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-7babf914-d0d8-4135-a8c0-07618ff8cae2 req-3253d438-db40-432d-bb2b-7c4c9ee27d04 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072125 Jun 28 03:19:31.576535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 105/209] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:19:31.697243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4b563012-1bcd-43d8-a6ff-da4f7e39cd67 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:31.777512 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4b563012-1bcd-43d8-a6ff-da4f7e39cd67 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 200 len: 1462 microversion: 2.1 time: 0.223200 Jun 28 03:19:31.783966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 105/210] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:31 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 1462 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:32.480888 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b2fea223-2987-461f-81cb-20484b3407b3 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:32.482165 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b2fea223-2987-461f-81cb-20484b3407b3 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:32.489942 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a41f9fe2-4a67-443c-977b-59c2d25b0563 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:32.491167 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a41f9fe2-4a67-443c-977b-59c2d25b0563 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:32.506700 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a41f9fe2-4a67-443c-977b-59c2d25b0563 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:32.511597 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a41f9fe2-4a67-443c-977b-59c2d25b0563 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:32.514641 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a41f9fe2-4a67-443c-977b-59c2d25b0563 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:32.518435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b2fea223-2987-461f-81cb-20484b3407b3 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:32.519726 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a41f9fe2-4a67-443c-977b-59c2d25b0563 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:32.525514 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b2fea223-2987-461f-81cb-20484b3407b3 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:32.529062 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b2fea223-2987-461f-81cb-20484b3407b3 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:32.530951 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b2fea223-2987-461f-81cb-20484b3407b3 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:33.211832 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a41f9fe2-4a67-443c-977b-59c2d25b0563 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:33.224591 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a41f9fe2-4a67-443c-977b-59c2d25b0563 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1291 microversion: 2.1 time: 0.738406 Jun 28 03:19:33.225697 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 106/211] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:32 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1291 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:19:33.230493 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-85220e9a-0fff-4735-9339-0f75892d24db tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:33.231144 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-85220e9a-0fff-4735-9339-0f75892d24db tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:33.251737 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-85220e9a-0fff-4735-9339-0f75892d24db tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:33.257176 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-85220e9a-0fff-4735-9339-0f75892d24db tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:33.258033 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-85220e9a-0fff-4735-9339-0f75892d24db tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:33.258471 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-85220e9a-0fff-4735-9339-0f75892d24db tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:33.288264 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-85220e9a-0fff-4735-9339-0f75892d24db tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] HTTP exception thrown: Instance 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 could not be found. Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-85220e9a-0fff-4735-9339-0f75892d24db tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Request method failure captured: Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 HTTP/1.1 Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunMekB_acw4AgXheueQAajNcG3uGp1FTGJL-LmrbKoUED7tXz3AAmo63V9_1jIBRc3vahRnq3qj3SmGSnH9343tdND3PylHzJdIQJQBSTPYPkqGRHLSvYAjKvE6NdbhA-28VPMbvCHsOurqn2P0c3KoRkfHyAxNUnmnQvi3R9_K5IQA Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: f2443fc439de4514badcb369d67462b9 Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesActionsTest-917178158 Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:19:33.289212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:19:33.290630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f2443fc439de4514badcb369d67462b9", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f2443fc439de4514badcb369d67462b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f2443fc439de4514badcb369d67462b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f2443fc439de4514badcb369d67462b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:19:33.290630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesActionsTest-917178158 Jun 28 03:19:33.290630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: f2443fc439de4514badcb369d67462b9 Jun 28 03:19:33.290630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesActionsTest-917178158 Jun 28 03:19:33.290630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesActionsTest-917178158-project Jun 28 03:19:33.290630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:19:33.290630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:19:33.290630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 7ffe193c62664564b930b6505754526b Jun 28 03:19:33.290630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesActionsTest-917178158-project Jun 28 03:19:33.290630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:19:33.290630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 could not be found. Jun 28 03:19:33.290630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '0ee00cc9-d66c-4a54-bf4c-9aff3a37f653'} Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 could not be found. Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:19:33.291353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 could not be found. Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 could not be found. Jun 28 03:19:33.292723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:33.303445 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-85220e9a-0fff-4735-9339-0f75892d24db tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Returning 404 to user: Instance 0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:19:33.304543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-85220e9a-0fff-4735-9339-0f75892d24db tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653" status: 404 len: 111 microversion: 2.1 time: 0.077839 Jun 28 03:19:33.305266 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 107/212] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:33 2022] GET /compute/v2.1/servers/0ee00cc9-d66c-4a54-bf4c-9aff3a37f653 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:19:33.338208 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-5f50b14a-9d71-481e-b101-b4ff09303e38 req-641e1389-6dbb-4bc8-8b0b-5fac6db5e117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a35380f6-a737-4573-af26-5e18f9cd0175", "tag": "68ea87c6-19dc-47a0-b7ab-ab509eabdab3"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:33.356758 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-5f50b14a-9d71-481e-b101-b4ff09303e38 req-641e1389-6dbb-4bc8-8b0b-5fac6db5e117 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:33.360002 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-5f50b14a-9d71-481e-b101-b4ff09303e38 req-641e1389-6dbb-4bc8-8b0b-5fac6db5e117 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:33.405763 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-5f50b14a-9d71-481e-b101-b4ff09303e38 req-641e1389-6dbb-4bc8-8b0b-5fac6db5e117 service nova] Creating event network-changed:68ea87c6-19dc-47a0-b7ab-ab509eabdab3 for instance a35380f6-a737-4573-af26-5e18f9cd0175 on hv-cinder-84684 Jun 28 03:19:33.425118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-5f50b14a-9d71-481e-b101-b4ff09303e38 req-641e1389-6dbb-4bc8-8b0b-5fac6db5e117 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106334 Jun 28 03:19:33.425677 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 108/213] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:19:33.545456 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-917435184", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "networks": [{"uuid": "6b3cf016-a33e-448c-823a-e4405f148035"}]}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:33.601836 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b2fea223-2987-461f-81cb-20484b3407b3 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:33.624391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b2fea223-2987-461f-81cb-20484b3407b3 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1315 microversion: 2.1 time: 1.143749 Jun 28 03:19:33.630671 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 106/214] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:32 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1315 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:33.634516 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] validate_networks() for [('6b3cf016-a33e-448c-823a-e4405f148035', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:19:34.243672 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-78b661a2-705c-40a5-9870-928b4c7b3090 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:34.244637 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-78b661a2-705c-40a5-9870-928b4c7b3090 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:34.253539 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-78b661a2-705c-40a5-9870-928b4c7b3090 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:34.255210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-78b661a2-705c-40a5-9870-928b4c7b3090 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:34.257011 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-78b661a2-705c-40a5-9870-928b4c7b3090 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:34.258455 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-78b661a2-705c-40a5-9870-928b4c7b3090 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:34.497113 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-78b661a2-705c-40a5-9870-928b4c7b3090 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:34.507257 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-78b661a2-705c-40a5-9870-928b4c7b3090 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1279 microversion: 2.1 time: 0.268245 Jun 28 03:19:34.513540 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 107/215] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:34 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1279 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:34.647976 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-32539834-1023-468d-a7a3-c17b353811ea tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:34.648930 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-32539834-1023-468d-a7a3-c17b353811ea tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:34.662333 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-32539834-1023-468d-a7a3-c17b353811ea tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:34.664467 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-32539834-1023-468d-a7a3-c17b353811ea tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:34.667456 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-32539834-1023-468d-a7a3-c17b353811ea tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:34.668241 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-32539834-1023-468d-a7a3-c17b353811ea tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:34.683795 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:19:34.684367 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:19:34.684876 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:19:34.685307 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:19:34.685720 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:19:34.701307 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:34.703896 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:34.704781 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:34.705210 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:34.744996 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Getting quotas for project f2443fc439de4514badcb369d67462b9. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:19:34.765129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Getting quotas for user 7ffe193c62664564b930b6505754526b and project f2443fc439de4514badcb369d67462b9. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:19:34.800561 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:19:34.803884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:19:34.861006 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-32539834-1023-468d-a7a3-c17b353811ea tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:34.870215 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-32539834-1023-468d-a7a3-c17b353811ea tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1315 microversion: 2.1 time: 0.227066 Jun 28 03:19:34.874082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 108/216] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:34 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:19:34.886794 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6bd5720f-cc22-492f-8fd8-5f3b935d9aff tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.346192 Jun 28 03:19:34.887543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 109/217] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:19:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 28 03:19:34.898177 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-37273e74-a284-4ffa-8217-a14f3f3ce3fa tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:34.898779 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-37273e74-a284-4ffa-8217-a14f3f3ce3fa tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:34.975692 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-37273e74-a284-4ffa-8217-a14f3f3ce3fa tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:34.998071 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-37273e74-a284-4ffa-8217-a14f3f3ce3fa tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1213 microversion: 2.1 time: 0.100077 Jun 28 03:19:34.999744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 109/218] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:34 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:35.530137 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-69b0af2b-20bd-42a3-abfa-20a3f16927c4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:35.531136 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-69b0af2b-20bd-42a3-abfa-20a3f16927c4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:35.540667 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-69b0af2b-20bd-42a3-abfa-20a3f16927c4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:35.546340 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-69b0af2b-20bd-42a3-abfa-20a3f16927c4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:35.547502 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-69b0af2b-20bd-42a3-abfa-20a3f16927c4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:35.549186 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-69b0af2b-20bd-42a3-abfa-20a3f16927c4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:35.703389 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-69b0af2b-20bd-42a3-abfa-20a3f16927c4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:35.715172 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-69b0af2b-20bd-42a3-abfa-20a3f16927c4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1279 microversion: 2.1 time: 0.189425 Jun 28 03:19:35.719554 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 110/219] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:35 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1279 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:35.890063 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-27860334-e237-4d33-ae73-e0fe2f99eb36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:35.890668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-27860334-e237-4d33-ae73-e0fe2f99eb36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:35.910844 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-27860334-e237-4d33-ae73-e0fe2f99eb36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:35.912290 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-27860334-e237-4d33-ae73-e0fe2f99eb36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:35.913712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-27860334-e237-4d33-ae73-e0fe2f99eb36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:35.914152 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-27860334-e237-4d33-ae73-e0fe2f99eb36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:36.019388 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-53630804-525e-4410-8588-8d83a7724fd9 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:36.020052 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-53630804-525e-4410-8588-8d83a7724fd9 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:36.059541 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-53630804-525e-4410-8588-8d83a7724fd9 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:36.061348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-53630804-525e-4410-8588-8d83a7724fd9 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:36.062548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-53630804-525e-4410-8588-8d83a7724fd9 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:36.066084 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-53630804-525e-4410-8588-8d83a7724fd9 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:36.244852 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-53630804-525e-4410-8588-8d83a7724fd9 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:36.252782 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-53630804-525e-4410-8588-8d83a7724fd9 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1209 microversion: 2.1 time: 0.239758 Jun 28 03:19:36.253896 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 111/220] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:36 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1209 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:19:36.355283 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-27860334-e237-4d33-ae73-e0fe2f99eb36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:36.367097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-27860334-e237-4d33-ae73-e0fe2f99eb36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1315 microversion: 2.1 time: 0.478991 Jun 28 03:19:36.367689 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 110/221] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:35 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:36.735697 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7948b98a-6734-4e68-a535-bba84bdfeb5c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:36.736335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7948b98a-6734-4e68-a535-bba84bdfeb5c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:36.746116 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7948b98a-6734-4e68-a535-bba84bdfeb5c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:36.754130 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7948b98a-6734-4e68-a535-bba84bdfeb5c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:36.755372 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7948b98a-6734-4e68-a535-bba84bdfeb5c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:36.756041 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7948b98a-6734-4e68-a535-bba84bdfeb5c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:37.095813 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7948b98a-6734-4e68-a535-bba84bdfeb5c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:37.128033 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7948b98a-6734-4e68-a535-bba84bdfeb5c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1321 microversion: 2.1 time: 0.386838 Jun 28 03:19:37.129265 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 112/222] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:36 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:37.270981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-291c9b6f-9387-4a15-b6ca-82990f008d09 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:37.271588 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-291c9b6f-9387-4a15-b6ca-82990f008d09 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:37.294116 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-291c9b6f-9387-4a15-b6ca-82990f008d09 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:37.294555 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-291c9b6f-9387-4a15-b6ca-82990f008d09 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:37.295339 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-291c9b6f-9387-4a15-b6ca-82990f008d09 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:37.295763 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-291c9b6f-9387-4a15-b6ca-82990f008d09 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:37.385644 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9da96883-57eb-460b-b19b-84c47999eed9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:37.387735 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9da96883-57eb-460b-b19b-84c47999eed9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:37.412453 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9da96883-57eb-460b-b19b-84c47999eed9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:37.413983 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9da96883-57eb-460b-b19b-84c47999eed9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:37.417061 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9da96883-57eb-460b-b19b-84c47999eed9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:37.422111 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9da96883-57eb-460b-b19b-84c47999eed9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:37.448089 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-291c9b6f-9387-4a15-b6ca-82990f008d09 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:37.461246 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-291c9b6f-9387-4a15-b6ca-82990f008d09 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1271 microversion: 2.1 time: 0.194124 Jun 28 03:19:37.461838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 111/223] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:37 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1271 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:37.821396 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9da96883-57eb-460b-b19b-84c47999eed9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:37.834756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9da96883-57eb-460b-b19b-84c47999eed9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1315 microversion: 2.1 time: 0.453544 Jun 28 03:19:37.846346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 113/224] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:37 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:37.949661 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-2145f68f-5bbd-41ae-8a0e-44e4cf5f06cb req-6b615df2-0ba6-4bea-8759-b9baf8c3b048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fbc89ef-8230-45d5-b3ee-efb863e5340e", "tag": "f19332ea-cc5d-476d-b4fd-c455a47a5f3f"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:37.962407 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-2145f68f-5bbd-41ae-8a0e-44e4cf5f06cb req-6b615df2-0ba6-4bea-8759-b9baf8c3b048 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:37.962845 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-2145f68f-5bbd-41ae-8a0e-44e4cf5f06cb req-6b615df2-0ba6-4bea-8759-b9baf8c3b048 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:38.004379 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-2145f68f-5bbd-41ae-8a0e-44e4cf5f06cb req-6b615df2-0ba6-4bea-8759-b9baf8c3b048 service nova] Creating event network-changed:f19332ea-cc5d-476d-b4fd-c455a47a5f3f for instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e on hv-cinder-84684 Jun 28 03:19:38.015079 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-2145f68f-5bbd-41ae-8a0e-44e4cf5f06cb req-6b615df2-0ba6-4bea-8759-b9baf8c3b048 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070616 Jun 28 03:19:38.018938 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 112/225] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:19:38.147877 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b49c3582-3bb3-42b4-8491-9755c035bd2f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:38.148693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b49c3582-3bb3-42b4-8491-9755c035bd2f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:38.165916 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b49c3582-3bb3-42b4-8491-9755c035bd2f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:38.174618 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b49c3582-3bb3-42b4-8491-9755c035bd2f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:38.175397 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b49c3582-3bb3-42b4-8491-9755c035bd2f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:38.175911 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b49c3582-3bb3-42b4-8491-9755c035bd2f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:38.483219 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e1380b66-376e-4fbe-a161-f5396f08455d tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:38.487782 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e1380b66-376e-4fbe-a161-f5396f08455d tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:38.505567 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e1380b66-376e-4fbe-a161-f5396f08455d tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:38.506255 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e1380b66-376e-4fbe-a161-f5396f08455d tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:38.507277 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e1380b66-376e-4fbe-a161-f5396f08455d tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:38.507909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e1380b66-376e-4fbe-a161-f5396f08455d tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:38.679309 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e1380b66-376e-4fbe-a161-f5396f08455d tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:38.693083 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e1380b66-376e-4fbe-a161-f5396f08455d tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1271 microversion: 2.1 time: 0.217149 Jun 28 03:19:38.695885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 113/226] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:38 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:19:38.777287 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b49c3582-3bb3-42b4-8491-9755c035bd2f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:38.786587 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b49c3582-3bb3-42b4-8491-9755c035bd2f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1321 microversion: 2.1 time: 0.643395 Jun 28 03:19:38.788822 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 114/227] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:38 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1321 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:38.852023 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-838fdc73-db70-4977-b533-9a7a27d2f32f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:38.852850 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-838fdc73-db70-4977-b533-9a7a27d2f32f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:38.862010 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-838fdc73-db70-4977-b533-9a7a27d2f32f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:38.865907 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-838fdc73-db70-4977-b533-9a7a27d2f32f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:38.866813 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-838fdc73-db70-4977-b533-9a7a27d2f32f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:38.868248 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-838fdc73-db70-4977-b533-9a7a27d2f32f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:39.384019 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-838fdc73-db70-4977-b533-9a7a27d2f32f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:39.390517 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:39.392808 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-838fdc73-db70-4977-b533-9a7a27d2f32f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1315 microversion: 2.1 time: 0.545104 Jun 28 03:19:39.403286 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 114/228] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:38 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:39.715194 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3599be30-0291-4987-a8a3-dc1bb23146dc tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:39.716045 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3599be30-0291-4987-a8a3-dc1bb23146dc tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:39.727435 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3599be30-0291-4987-a8a3-dc1bb23146dc tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:39.727782 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3599be30-0291-4987-a8a3-dc1bb23146dc tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:39.728984 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3599be30-0291-4987-a8a3-dc1bb23146dc tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:39.729446 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3599be30-0291-4987-a8a3-dc1bb23146dc tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:39.809328 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6694d511-1286-4a47-9ee1-a36044acf4f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:39.810638 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6694d511-1286-4a47-9ee1-a36044acf4f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:39.817257 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=4 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:39.828666 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6694d511-1286-4a47-9ee1-a36044acf4f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:39.829126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6694d511-1286-4a47-9ee1-a36044acf4f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:39.829911 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6694d511-1286-4a47-9ee1-a36044acf4f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:39.830354 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6694d511-1286-4a47-9ee1-a36044acf4f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:40.164965 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3599be30-0291-4987-a8a3-dc1bb23146dc tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:40.175263 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3599be30-0291-4987-a8a3-dc1bb23146dc tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1313 microversion: 2.1 time: 0.466772 Jun 28 03:19:40.176270 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 115/229] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:39 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:40.188377 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-bf1d35b7-5111-4063-a8c7-c407e2edf3b6 req-0e89aac0-2c58-46ae-aa89-3090ac283246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e", "tag": "4889afde-ba46-4d85-9672-9444704f0439"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:40.201942 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bf1d35b7-5111-4063-a8c7-c407e2edf3b6 req-0e89aac0-2c58-46ae-aa89-3090ac283246 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:40.202373 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bf1d35b7-5111-4063-a8c7-c407e2edf3b6 req-0e89aac0-2c58-46ae-aa89-3090ac283246 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:40.223597 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6694d511-1286-4a47-9ee1-a36044acf4f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:40.234658 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6694d511-1286-4a47-9ee1-a36044acf4f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1321 microversion: 2.1 time: 0.431918 Jun 28 03:19:40.235825 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 115/230] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:39 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:19:40.241202 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-bf1d35b7-5111-4063-a8c7-c407e2edf3b6 req-0e89aac0-2c58-46ae-aa89-3090ac283246 service nova] Creating event network-changed:4889afde-ba46-4d85-9672-9444704f0439 for instance 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e on hv-cinder-84684 Jun 28 03:19:40.253207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-bf1d35b7-5111-4063-a8c7-c407e2edf3b6 req-0e89aac0-2c58-46ae-aa89-3090ac283246 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075239 Jun 28 03:19:40.253809 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 116/231] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:19:40.412007 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-809307a3-da1b-4317-b7b5-96cc1a519aa1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:40.412756 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-809307a3-da1b-4317-b7b5-96cc1a519aa1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:40.430561 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-809307a3-da1b-4317-b7b5-96cc1a519aa1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:40.431914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-809307a3-da1b-4317-b7b5-96cc1a519aa1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:40.432810 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-809307a3-da1b-4317-b7b5-96cc1a519aa1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:40.433471 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-809307a3-da1b-4317-b7b5-96cc1a519aa1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:40.923355 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-809307a3-da1b-4317-b7b5-96cc1a519aa1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:40.933960 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-809307a3-da1b-4317-b7b5-96cc1a519aa1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1315 microversion: 2.1 time: 0.526711 Jun 28 03:19:40.937003 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 116/232] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:40 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:41.192578 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-285e9d67-2866-4a79-b9f8-db4a5adc550f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:41.193274 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-285e9d67-2866-4a79-b9f8-db4a5adc550f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:41.208578 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-285e9d67-2866-4a79-b9f8-db4a5adc550f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:41.209023 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-285e9d67-2866-4a79-b9f8-db4a5adc550f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:41.209796 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-285e9d67-2866-4a79-b9f8-db4a5adc550f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:41.210227 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-285e9d67-2866-4a79-b9f8-db4a5adc550f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:41.226169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:41.251326 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-656ef8ca-22ff-4e9f-9335-8badd6fa988a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:41.252009 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-656ef8ca-22ff-4e9f-9335-8badd6fa988a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:41.259684 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-656ef8ca-22ff-4e9f-9335-8badd6fa988a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:41.268337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-656ef8ca-22ff-4e9f-9335-8badd6fa988a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:41.269310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-656ef8ca-22ff-4e9f-9335-8badd6fa988a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:41.269752 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-656ef8ca-22ff-4e9f-9335-8badd6fa988a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:41.784970 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-285e9d67-2866-4a79-b9f8-db4a5adc550f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:41.796871 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-285e9d67-2866-4a79-b9f8-db4a5adc550f tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1313 microversion: 2.1 time: 0.608396 Jun 28 03:19:41.797797 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 117/233] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:41 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1313 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:41.800936 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-656ef8ca-22ff-4e9f-9335-8badd6fa988a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:41.803581 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-160c7ff0-32e6-4858-a488-289cf69c3e4d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:41.804333 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-160c7ff0-32e6-4858-a488-289cf69c3e4d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:41.812802 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-656ef8ca-22ff-4e9f-9335-8badd6fa988a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1321 microversion: 2.1 time: 0.565529 Jun 28 03:19:41.813766 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 117/234] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:41 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1321 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:41.816472 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-160c7ff0-32e6-4858-a488-289cf69c3e4d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:41.816939 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-160c7ff0-32e6-4858-a488-289cf69c3e4d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:41.817712 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-160c7ff0-32e6-4858-a488-289cf69c3e4d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:41.818145 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-160c7ff0-32e6-4858-a488-289cf69c3e4d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:41.846200 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-160c7ff0-32e6-4858-a488-289cf69c3e4d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/ips" status: 200 len: 152 microversion: 2.20 time: 0.046847 Jun 28 03:19:41.846826 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 118/235] 10.222.0.44 () {60 vars in 1288 bytes} [Tue Jun 28 03:19:41 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:19:41.952460 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d63fc70a-e624-4f91-9941-41b3f6c88be2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:41.953153 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d63fc70a-e624-4f91-9941-41b3f6c88be2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:41.994979 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d63fc70a-e624-4f91-9941-41b3f6c88be2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:41.995625 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d63fc70a-e624-4f91-9941-41b3f6c88be2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:41.997247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d63fc70a-e624-4f91-9941-41b3f6c88be2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:41.998660 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d63fc70a-e624-4f91-9941-41b3f6c88be2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:42.364046 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d63fc70a-e624-4f91-9941-41b3f6c88be2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:42.374400 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d63fc70a-e624-4f91-9941-41b3f6c88be2 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1315 microversion: 2.1 time: 0.426381 Jun 28 03:19:42.385131 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 118/236] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:41 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:42.409358 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-d57935eb-53e7-4200-b086-c30b5fed7ba4 req-db047d2e-5620-4270-9d4d-439286435006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc7bc682-05a8-4269-a1ce-afeef9aab527", "tag": "44c89579-996d-44c2-b42b-7b85bf9483c0"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:42.433427 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-d57935eb-53e7-4200-b086-c30b5fed7ba4 req-db047d2e-5620-4270-9d4d-439286435006 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:42.434077 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-d57935eb-53e7-4200-b086-c30b5fed7ba4 req-db047d2e-5620-4270-9d4d-439286435006 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:42.462188 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-d57935eb-53e7-4200-b086-c30b5fed7ba4 req-db047d2e-5620-4270-9d4d-439286435006 service nova] Creating event network-changed:44c89579-996d-44c2-b42b-7b85bf9483c0 for instance bc7bc682-05a8-4269-a1ce-afeef9aab527 on hv-cinder-84684 Jun 28 03:19:42.474273 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-d57935eb-53e7-4200-b086-c30b5fed7ba4 req-db047d2e-5620-4270-9d4d-439286435006 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087412 Jun 28 03:19:42.477222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 119/237] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:19:42.814473 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-dfdf0ec9-2b87-4311-8dc8-ae2cf0a37fab tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:42.815421 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-dfdf0ec9-2b87-4311-8dc8-ae2cf0a37fab tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:42.829397 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dfdf0ec9-2b87-4311-8dc8-ae2cf0a37fab tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:42.830089 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dfdf0ec9-2b87-4311-8dc8-ae2cf0a37fab tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:42.833351 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dfdf0ec9-2b87-4311-8dc8-ae2cf0a37fab tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:42.833956 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dfdf0ec9-2b87-4311-8dc8-ae2cf0a37fab tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:42.970530 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7b89638f-2f5f-47b2-806c-d0176cb62fa8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Action: 'create', calling method: .version_select at 0x7f53f2583040>, body: {"keypair": {"name": "tempest-TestShelveInstance-378644166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKWd8NvE9ih8fJ6L5huueLT5s7mPKOwtZlNgX71VBi0WrS/NDkb2vNWRb+PnQYr+xR/vJbGusDBXUwjYwJE+S1YfgZgwreZUKjNcJ606iKcTUifIJGSZK2I14u9gwqxRg=="}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:43.022214 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-7b89638f-2f5f-47b2-806c-d0176cb62fa8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Getting quotas for project bcfe66d2ca71404e9b032806db987d4d. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:19:43.042778 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-7b89638f-2f5f-47b2-806c-d0176cb62fa8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Getting quotas for user c20be92bb6664d518ad0550c43b5e378 and project bcfe66d2ca71404e9b032806db987d4d. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:19:43.138411 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-dfdf0ec9-2b87-4311-8dc8-ae2cf0a37fab tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:43.151856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-dfdf0ec9-2b87-4311-8dc8-ae2cf0a37fab tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1313 microversion: 2.1 time: 0.341625 Jun 28 03:19:43.153305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 120/238] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:42 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:43.157674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7b89638f-2f5f-47b2-806c-d0176cb62fa8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.870596 Jun 28 03:19:43.158295 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 119/239] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 28 03:19:42 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:19:43.165343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d205d33f-8af8-412e-815a-121a2bf1d680 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:43.167086 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d205d33f-8af8-412e-815a-121a2bf1d680 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:43.167237 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-cf824773-415d-4b23-8754-dda92f36977e req-3d65a74e-6e55-43b4-ac1a-7f842aa0c31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35380f6-a737-4573-af26-5e18f9cd0175", "name": "network-vif-plugged", "status": "completed", "tag": "68ea87c6-19dc-47a0-b7ab-ab509eabdab3"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:43.181554 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d205d33f-8af8-412e-815a-121a2bf1d680 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:43.182048 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d205d33f-8af8-412e-815a-121a2bf1d680 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:43.182818 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d205d33f-8af8-412e-815a-121a2bf1d680 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:43.183484 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d205d33f-8af8-412e-815a-121a2bf1d680 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:43.200375 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-cf824773-415d-4b23-8754-dda92f36977e req-3d65a74e-6e55-43b4-ac1a-7f842aa0c31d service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:43.200898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-cf824773-415d-4b23-8754-dda92f36977e req-3d65a74e-6e55-43b4-ac1a-7f842aa0c31d service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:43.245714 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-cf824773-415d-4b23-8754-dda92f36977e req-3d65a74e-6e55-43b4-ac1a-7f842aa0c31d service nova] Creating event network-vif-plugged:68ea87c6-19dc-47a0-b7ab-ab509eabdab3 for instance a35380f6-a737-4573-af26-5e18f9cd0175 on hv-cinder-84684 Jun 28 03:19:43.266080 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-cf824773-415d-4b23-8754-dda92f36977e req-3d65a74e-6e55-43b4-ac1a-7f842aa0c31d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106004 Jun 28 03:19:43.269710 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 120/240] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:19:43.394366 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d53c8d30-e45d-491c-b2a4-0809e2294c9a tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:43.395091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d53c8d30-e45d-491c-b2a4-0809e2294c9a tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:43.413376 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d53c8d30-e45d-491c-b2a4-0809e2294c9a tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:43.418507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d53c8d30-e45d-491c-b2a4-0809e2294c9a tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:43.419435 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d53c8d30-e45d-491c-b2a4-0809e2294c9a tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:43.419773 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d53c8d30-e45d-491c-b2a4-0809e2294c9a tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:44.272018 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d205d33f-8af8-412e-815a-121a2bf1d680 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:44.296672 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d205d33f-8af8-412e-815a-121a2bf1d680 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1321 microversion: 2.1 time: 1.140235 Jun 28 03:19:44.305780 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 121/241] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:43 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1321 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:44.319817 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-fda5dbd2-00e2-4478-9bf1-e1e36b39e331 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:44.320670 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-fda5dbd2-00e2-4478-9bf1-e1e36b39e331 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:44.340548 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fda5dbd2-00e2-4478-9bf1-e1e36b39e331 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:44.341285 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fda5dbd2-00e2-4478-9bf1-e1e36b39e331 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:44.342789 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fda5dbd2-00e2-4478-9bf1-e1e36b39e331 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:44.345212 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fda5dbd2-00e2-4478-9bf1-e1e36b39e331 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:44.385786 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d53c8d30-e45d-491c-b2a4-0809e2294c9a tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:44.387891 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.objects.instance [None req-fda5dbd2-00e2-4478-9bf1-e1e36b39e331 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lazy-loading 'flavor' on Instance uuid 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 {{(pid=117681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:19:44.399892 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d53c8d30-e45d-491c-b2a4-0809e2294c9a tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1315 microversion: 2.1 time: 1.009123 Jun 28 03:19:44.400768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 121/242] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:43 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1315 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:44.415810 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f2e6ac7a-283b-4cef-ae77-72f369c6759c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:44.416721 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f2e6ac7a-283b-4cef-ae77-72f369c6759c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:44.427365 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f2e6ac7a-283b-4cef-ae77-72f369c6759c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:44.427811 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f2e6ac7a-283b-4cef-ae77-72f369c6759c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:44.428678 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f2e6ac7a-283b-4cef-ae77-72f369c6759c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:44.429138 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f2e6ac7a-283b-4cef-ae77-72f369c6759c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:44.722329 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=4 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:44.729406 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f2e6ac7a-283b-4cef-ae77-72f369c6759c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:44.743457 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f2e6ac7a-283b-4cef-ae77-72f369c6759c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1313 microversion: 2.1 time: 0.337799 Jun 28 03:19:44.760687 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 122/243] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:44 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:44.994103 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=18 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:45.140814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-fda5dbd2-00e2-4478-9bf1-e1e36b39e331 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "POST /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/action" status: 202 len: 0 microversion: 2.20 time: 0.830506 Jun 28 03:19:45.141673 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 122/244] 10.222.0.44 () {62 vars in 1318 bytes} [Tue Jun 28 03:19:44 2022] POST /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/action => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:19:45.150764 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6772a7c1-7181-404f-bb0f-bb0f3f9ec7fe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:45.151502 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6772a7c1-7181-404f-bb0f-bb0f3f9ec7fe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:45.168145 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6772a7c1-7181-404f-bb0f-bb0f3f9ec7fe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:45.168927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6772a7c1-7181-404f-bb0f-bb0f3f9ec7fe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:45.169397 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6772a7c1-7181-404f-bb0f-bb0f3f9ec7fe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:45.169846 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6772a7c1-7181-404f-bb0f-bb0f3f9ec7fe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:45.290019 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-b80ffa08-94a3-4c05-ac38-6606dcb5c6fb req-f798b7f8-7171-4204-8dcf-2845a457a3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbc89ef-8230-45d5-b3ee-efb863e5340e", "name": "network-vif-plugged", "status": "completed", "tag": "f19332ea-cc5d-476d-b4fd-c455a47a5f3f"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:45.303805 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-b80ffa08-94a3-4c05-ac38-6606dcb5c6fb req-f798b7f8-7171-4204-8dcf-2845a457a3c7 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:45.304477 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-b80ffa08-94a3-4c05-ac38-6606dcb5c6fb req-f798b7f8-7171-4204-8dcf-2845a457a3c7 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:45.347609 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-b80ffa08-94a3-4c05-ac38-6606dcb5c6fb req-f798b7f8-7171-4204-8dcf-2845a457a3c7 service nova] Creating event network-vif-plugged:f19332ea-cc5d-476d-b4fd-c455a47a5f3f for instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e on hv-cinder-84684 Jun 28 03:19:45.357043 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-b80ffa08-94a3-4c05-ac38-6606dcb5c6fb req-f798b7f8-7171-4204-8dcf-2845a457a3c7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072390 Jun 28 03:19:45.361316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 123/245] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 28 03:19:45.371879 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-5a837cad-a50e-4f7a-abd9-43ae6d97351d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:45.373133 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-5a837cad-a50e-4f7a-abd9-43ae6d97351d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:45.395238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5a837cad-a50e-4f7a-abd9-43ae6d97351d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:45.395852 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5a837cad-a50e-4f7a-abd9-43ae6d97351d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:45.396817 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5a837cad-a50e-4f7a-abd9-43ae6d97351d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:45.397448 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5a837cad-a50e-4f7a-abd9-43ae6d97351d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:45.609612 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6772a7c1-7181-404f-bb0f-bb0f3f9ec7fe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:45.624106 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6772a7c1-7181-404f-bb0f-bb0f3f9ec7fe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:45.628353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6772a7c1-7181-404f-bb0f-bb0f3f9ec7fe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:45.632385 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6772a7c1-7181-404f-bb0f-bb0f3f9ec7fe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.485060 Jun 28 03:19:45.645880 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 123/246] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:19:45 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:19:45.658383 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-08a1be9a-e75f-49f4-880a-cfc8321b23e9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:45.663303 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-08a1be9a-e75f-49f4-880a-cfc8321b23e9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:45.681583 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-08a1be9a-e75f-49f4-880a-cfc8321b23e9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:45.683388 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-08a1be9a-e75f-49f4-880a-cfc8321b23e9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:45.685082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-08a1be9a-e75f-49f4-880a-cfc8321b23e9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:45.685905 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-08a1be9a-e75f-49f4-880a-cfc8321b23e9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:45.720269 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-5a837cad-a50e-4f7a-abd9-43ae6d97351d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:45.740284 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-5a837cad-a50e-4f7a-abd9-43ae6d97351d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1321 microversion: 2.1 time: 0.376482 Jun 28 03:19:45.757475 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 124/247] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:45 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:45.776135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d7173a22-1ecc-42e2-8da9-ee773889082a tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:45.791951 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d7173a22-1ecc-42e2-8da9-ee773889082a tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:45.834509 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d7173a22-1ecc-42e2-8da9-ee773889082a tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:45.839092 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d7173a22-1ecc-42e2-8da9-ee773889082a tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:45.841246 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d7173a22-1ecc-42e2-8da9-ee773889082a tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:45.848945 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d7173a22-1ecc-42e2-8da9-ee773889082a tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:46.123821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-08a1be9a-e75f-49f4-880a-cfc8321b23e9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:46.131607 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-08a1be9a-e75f-49f4-880a-cfc8321b23e9 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1465 microversion: 2.1 time: 0.482806 Jun 28 03:19:46.132430 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 124/248] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:45 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1465 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:46.181369 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1d693b9b-58cb-4c38-b21c-9eb8f722e563 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:46.182090 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1d693b9b-58cb-4c38-b21c-9eb8f722e563 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:46.189808 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1d693b9b-58cb-4c38-b21c-9eb8f722e563 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:46.190251 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1d693b9b-58cb-4c38-b21c-9eb8f722e563 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:46.191004 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1d693b9b-58cb-4c38-b21c-9eb8f722e563 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:46.191463 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1d693b9b-58cb-4c38-b21c-9eb8f722e563 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:46.234513 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d7173a22-1ecc-42e2-8da9-ee773889082a tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:46.235788 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1d693b9b-58cb-4c38-b21c-9eb8f722e563 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:19:46.250331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d7173a22-1ecc-42e2-8da9-ee773889082a tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1313 microversion: 2.1 time: 0.491077 Jun 28 03:19:46.251419 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 125/249] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:45 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:46.375979 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1d693b9b-58cb-4c38-b21c-9eb8f722e563 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 204 len: 0 microversion: 2.1 time: 0.199369 Jun 28 03:19:46.377131 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 125/250] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:19:46 2022] DELETE /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 28 03:19:46.386384 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-0c102c53-f96d-4c3b-9d84-d290034a385f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:46.387322 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-0c102c53-f96d-4c3b-9d84-d290034a385f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:46.395098 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0c102c53-f96d-4c3b-9d84-d290034a385f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:46.396029 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0c102c53-f96d-4c3b-9d84-d290034a385f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:46.396889 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0c102c53-f96d-4c3b-9d84-d290034a385f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:46.397940 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0c102c53-f96d-4c3b-9d84-d290034a385f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:46.622987 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-0c102c53-f96d-4c3b-9d84-d290034a385f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:46.634215 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-0c102c53-f96d-4c3b-9d84-d290034a385f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1471 microversion: 2.1 time: 0.252619 Jun 28 03:19:46.635855 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 126/251] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:46 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1471 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:46.661068 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3a5a6ebe-5676-4523-8a46-e2f6325cad72 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:46.661889 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3a5a6ebe-5676-4523-8a46-e2f6325cad72 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:46.669651 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3a5a6ebe-5676-4523-8a46-e2f6325cad72 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:46.670091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3a5a6ebe-5676-4523-8a46-e2f6325cad72 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:46.670864 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3a5a6ebe-5676-4523-8a46-e2f6325cad72 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:46.671297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3a5a6ebe-5676-4523-8a46-e2f6325cad72 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:46.758434 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-71c2af07-908e-4eef-beb2-00c31e09fd6a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:46.759925 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-71c2af07-908e-4eef-beb2-00c31e09fd6a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:46.766658 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-71c2af07-908e-4eef-beb2-00c31e09fd6a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:46.767101 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-71c2af07-908e-4eef-beb2-00c31e09fd6a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:46.769907 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-71c2af07-908e-4eef-beb2-00c31e09fd6a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:46.770342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-71c2af07-908e-4eef-beb2-00c31e09fd6a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:46.899787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3a5a6ebe-5676-4523-8a46-e2f6325cad72 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:46.914317 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3a5a6ebe-5676-4523-8a46-e2f6325cad72 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:46.920545 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3a5a6ebe-5676-4523-8a46-e2f6325cad72 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:46.924078 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3a5a6ebe-5676-4523-8a46-e2f6325cad72 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.269725 Jun 28 03:19:46.927531 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 126/252] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:19:46 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:19:46.954871 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-71c2af07-908e-4eef-beb2-00c31e09fd6a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:46.964405 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-71c2af07-908e-4eef-beb2-00c31e09fd6a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1321 microversion: 2.1 time: 0.209792 Jun 28 03:19:46.973016 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 127/253] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:46 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:47.268662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1b988b32-32f8-4924-b43c-3e9d21706d89 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:47.269455 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1b988b32-32f8-4924-b43c-3e9d21706d89 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:47.275629 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1b988b32-32f8-4924-b43c-3e9d21706d89 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:47.276133 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1b988b32-32f8-4924-b43c-3e9d21706d89 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:47.277579 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1b988b32-32f8-4924-b43c-3e9d21706d89 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:47.278053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1b988b32-32f8-4924-b43c-3e9d21706d89 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:47.328006 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9adfb5d0-f6bf-4921-9e83-98a377606c11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:47.328525 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-9adfb5d0-f6bf-4921-9e83-98a377606c11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:47.335292 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9adfb5d0-f6bf-4921-9e83-98a377606c11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:47.335705 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9adfb5d0-f6bf-4921-9e83-98a377606c11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:47.337866 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9adfb5d0-f6bf-4921-9e83-98a377606c11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:47.338308 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9adfb5d0-f6bf-4921-9e83-98a377606c11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:47.372547 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-9adfb5d0-f6bf-4921-9e83-98a377606c11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e/ips" status: 200 len: 149 microversion: 2.1 time: 0.058147 Jun 28 03:19:47.378642 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 128/254] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 28 03:19:47 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e/ips => generated 149 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:19:47.383710 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-cd31781d-2c9d-4882-ac95-3962314373d8 req-3697024d-9730-47bb-ac60-dffac4b408a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e", "name": "network-vif-plugged", "status": "completed", "tag": "4889afde-ba46-4d85-9672-9444704f0439"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:47.393909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-cd31781d-2c9d-4882-ac95-3962314373d8 req-3697024d-9730-47bb-ac60-dffac4b408a8 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:47.394983 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-cd31781d-2c9d-4882-ac95-3962314373d8 req-3697024d-9730-47bb-ac60-dffac4b408a8 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:47.407720 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-cd31781d-2c9d-4882-ac95-3962314373d8 req-3697024d-9730-47bb-ac60-dffac4b408a8 service nova] Creating event network-vif-plugged:4889afde-ba46-4d85-9672-9444704f0439 for instance 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e on hv-cinder-84684 Jun 28 03:19:47.413550 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-cd31781d-2c9d-4882-ac95-3962314373d8 req-3697024d-9730-47bb-ac60-dffac4b408a8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033478 Jun 28 03:19:47.414532 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 129/255] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:19:47.470213 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1b988b32-32f8-4924-b43c-3e9d21706d89 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:47.479822 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1b988b32-32f8-4924-b43c-3e9d21706d89 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1313 microversion: 2.1 time: 0.215531 Jun 28 03:19:47.481070 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 127/256] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:47 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:47.660520 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b2cb18a3-cb17-40d5-8b18-d7e1f10d794f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:47.661494 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b2cb18a3-cb17-40d5-8b18-d7e1f10d794f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:47.671046 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b2cb18a3-cb17-40d5-8b18-d7e1f10d794f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:47.673238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b2cb18a3-cb17-40d5-8b18-d7e1f10d794f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:47.674497 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b2cb18a3-cb17-40d5-8b18-d7e1f10d794f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:47.685438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b2cb18a3-cb17-40d5-8b18-d7e1f10d794f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:47.855603 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b2cb18a3-cb17-40d5-8b18-d7e1f10d794f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:47.863600 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b2cb18a3-cb17-40d5-8b18-d7e1f10d794f tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1471 microversion: 2.1 time: 0.209339 Jun 28 03:19:47.864177 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 130/257] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:47 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1471 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:47.945124 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-edf2e14f-419d-4574-99ed-0498af220d99 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:47.945718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-edf2e14f-419d-4574-99ed-0498af220d99 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:47.952889 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-edf2e14f-419d-4574-99ed-0498af220d99 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:47.953601 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-edf2e14f-419d-4574-99ed-0498af220d99 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:47.954464 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-edf2e14f-419d-4574-99ed-0498af220d99 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:47.954969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-edf2e14f-419d-4574-99ed-0498af220d99 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:47.981438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-0fe44a6c-d23d-458a-be1f-8455c441a19f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:47.982037 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-0fe44a6c-d23d-458a-be1f-8455c441a19f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:47.993539 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0fe44a6c-d23d-458a-be1f-8455c441a19f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:47.993990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0fe44a6c-d23d-458a-be1f-8455c441a19f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:47.996248 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0fe44a6c-d23d-458a-be1f-8455c441a19f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:47.997811 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0fe44a6c-d23d-458a-be1f-8455c441a19f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:48.205905 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-edf2e14f-419d-4574-99ed-0498af220d99 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:48.211572 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-0fe44a6c-d23d-458a-be1f-8455c441a19f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:48.215694 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:48.228449 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-edf2e14f-419d-4574-99ed-0498af220d99 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:48.230701 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-edf2e14f-419d-4574-99ed-0498af220d99 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:48.234370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-edf2e14f-419d-4574-99ed-0498af220d99 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.292894 Jun 28 03:19:48.235300 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 128/258] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:19:47 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:19:48.236028 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-0fe44a6c-d23d-458a-be1f-8455c441a19f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1321 microversion: 2.1 time: 0.257513 Jun 28 03:19:48.236632 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 131/259] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:47 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:48.497363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6f8822c7-deda-473f-941d-6d20dbe6004c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:48.497993 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6f8822c7-deda-473f-941d-6d20dbe6004c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:48.504084 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6f8822c7-deda-473f-941d-6d20dbe6004c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:48.504561 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6f8822c7-deda-473f-941d-6d20dbe6004c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:48.505320 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6f8822c7-deda-473f-941d-6d20dbe6004c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:48.505748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6f8822c7-deda-473f-941d-6d20dbe6004c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:48.669100 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6f8822c7-deda-473f-941d-6d20dbe6004c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:48.680774 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6f8822c7-deda-473f-941d-6d20dbe6004c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1313 microversion: 2.1 time: 0.187302 Jun 28 03:19:48.681361 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 129/260] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:48 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:48.856260 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3cbc1285-d408-4378-a0d9-968bc93f184d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53ab0343-5b6c-4519-aa43-54df07ed0660"}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:48.857373 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-3cbc1285-d408-4378-a0d9-968bc93f184d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:48.865375 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3cbc1285-d408-4378-a0d9-968bc93f184d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:48.865993 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3cbc1285-d408-4378-a0d9-968bc93f184d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:48.866750 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3cbc1285-d408-4378-a0d9-968bc93f184d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:48.867179 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3cbc1285-d408-4378-a0d9-968bc93f184d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:48.881488 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5623e159-ba15-4f39-b9e4-8e5b4d5628c1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:48.882271 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5623e159-ba15-4f39-b9e4-8e5b4d5628c1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:48.890664 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5623e159-ba15-4f39-b9e4-8e5b4d5628c1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:48.891418 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5623e159-ba15-4f39-b9e4-8e5b4d5628c1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:48.892429 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5623e159-ba15-4f39-b9e4-8e5b4d5628c1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:48.892861 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5623e159-ba15-4f39-b9e4-8e5b4d5628c1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:49.048511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5623e159-ba15-4f39-b9e4-8e5b4d5628c1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:49.056037 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5623e159-ba15-4f39-b9e4-8e5b4d5628c1 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1471 microversion: 2.1 time: 0.178479 Jun 28 03:19:49.056632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 130/261] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:48 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:19:49.252853 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bde0f6ce-2236-403a-a5c7-5f233b0cbce1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:49.253366 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-bde0f6ce-2236-403a-a5c7-5f233b0cbce1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:49.259550 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bde0f6ce-2236-403a-a5c7-5f233b0cbce1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:49.259990 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bde0f6ce-2236-403a-a5c7-5f233b0cbce1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:49.260837 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bde0f6ce-2236-403a-a5c7-5f233b0cbce1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:49.261278 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bde0f6ce-2236-403a-a5c7-5f233b0cbce1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:49.463463 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-bde0f6ce-2236-403a-a5c7-5f233b0cbce1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:49.475030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-bde0f6ce-2236-403a-a5c7-5f233b0cbce1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1321 microversion: 2.1 time: 0.226061 Jun 28 03:19:49.476201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 131/262] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:49 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:49.481829 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f69b3af1-c760-488b-9c4b-7eea07f8a37e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:49.482602 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f69b3af1-c760-488b-9c4b-7eea07f8a37e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:49.495439 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f69b3af1-c760-488b-9c4b-7eea07f8a37e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:49.495870 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f69b3af1-c760-488b-9c4b-7eea07f8a37e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:49.496899 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f69b3af1-c760-488b-9c4b-7eea07f8a37e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:49.497423 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f69b3af1-c760-488b-9c4b-7eea07f8a37e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:49.732079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f69b3af1-c760-488b-9c4b-7eea07f8a37e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:49.747756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f69b3af1-c760-488b-9c4b-7eea07f8a37e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:49.749324 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f69b3af1-c760-488b-9c4b-7eea07f8a37e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:49.750493 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f69b3af1-c760-488b-9c4b-7eea07f8a37e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.273089 Jun 28 03:19:49.751357 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 132/263] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:19:49 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:19:49.755875 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a7a3a8ae-10c0-4769-acf0-8b9f0df8d1c0 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:49.756715 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a7a3a8ae-10c0-4769-acf0-8b9f0df8d1c0 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:49.763143 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a7a3a8ae-10c0-4769-acf0-8b9f0df8d1c0 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:49.763580 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a7a3a8ae-10c0-4769-acf0-8b9f0df8d1c0 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:49.764378 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a7a3a8ae-10c0-4769-acf0-8b9f0df8d1c0 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:49.764794 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a7a3a8ae-10c0-4769-acf0-8b9f0df8d1c0 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:50.058431 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a7a3a8ae-10c0-4769-acf0-8b9f0df8d1c0 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:50.066651 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a7a3a8ae-10c0-4769-acf0-8b9f0df8d1c0 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1313 microversion: 2.1 time: 0.314252 Jun 28 03:19:50.067621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 133/264] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:49 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:50.075569 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fe8c2b64-8efa-4732-961b-1cf02e672167 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:50.076451 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fe8c2b64-8efa-4732-961b-1cf02e672167 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:50.082800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fe8c2b64-8efa-4732-961b-1cf02e672167 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:50.083545 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fe8c2b64-8efa-4732-961b-1cf02e672167 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:50.084395 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fe8c2b64-8efa-4732-961b-1cf02e672167 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:50.084924 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fe8c2b64-8efa-4732-961b-1cf02e672167 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:50.101172 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:50.123922 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3cbc1285-d408-4378-a0d9-968bc93f184d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "POST /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.272537 Jun 28 03:19:50.124564 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 132/265] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:19:48 2022] POST /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e/os-volume_attachments => generated 194 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:19:50.352504 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fe8c2b64-8efa-4732-961b-1cf02e672167 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:50.361265 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fe8c2b64-8efa-4732-961b-1cf02e672167 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1471 microversion: 2.1 time: 0.290189 Jun 28 03:19:50.370884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 134/266] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:50 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1471 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:50.497930 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a0598119-eed9-412c-be05-78318d287ef7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:50.498612 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a0598119-eed9-412c-be05-78318d287ef7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:50.506979 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a0598119-eed9-412c-be05-78318d287ef7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:50.507424 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a0598119-eed9-412c-be05-78318d287ef7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:50.508211 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a0598119-eed9-412c-be05-78318d287ef7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:50.514147 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a0598119-eed9-412c-be05-78318d287ef7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:50.600930 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-2cfdbdd9-8926-4be5-a875-858b22488581 req-e75a4851-14ba-4d76-8d66-bf535c6a8d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a35380f6-a737-4573-af26-5e18f9cd0175", "name": "network-vif-deleted", "tag": "68ea87c6-19dc-47a0-b7ab-ab509eabdab3"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:50.611212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-2cfdbdd9-8926-4be5-a875-858b22488581 req-e75a4851-14ba-4d76-8d66-bf535c6a8d57 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:50.612576 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-2cfdbdd9-8926-4be5-a875-858b22488581 req-e75a4851-14ba-4d76-8d66-bf535c6a8d57 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:50.629818 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-2cfdbdd9-8926-4be5-a875-858b22488581 req-e75a4851-14ba-4d76-8d66-bf535c6a8d57 service nova] Creating event network-vif-deleted:68ea87c6-19dc-47a0-b7ab-ab509eabdab3 for instance a35380f6-a737-4573-af26-5e18f9cd0175 on hv-cinder-84684 Jun 28 03:19:50.636864 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-2cfdbdd9-8926-4be5-a875-858b22488581 req-e75a4851-14ba-4d76-8d66-bf535c6a8d57 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039106 Jun 28 03:19:50.637812 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 135/267] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:19:50.743172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a0598119-eed9-412c-be05-78318d287ef7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:50.759592 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a0598119-eed9-412c-be05-78318d287ef7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1321 microversion: 2.1 time: 0.269060 Jun 28 03:19:50.761143 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 133/268] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:50 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:50.775844 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a013796f-23fa-4151-8d08-418f4df50b4c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:50.776559 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a013796f-23fa-4151-8d08-418f4df50b4c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:50.778687 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:50.789400 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a013796f-23fa-4151-8d08-418f4df50b4c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:50.790346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a013796f-23fa-4151-8d08-418f4df50b4c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:50.792013 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a013796f-23fa-4151-8d08-418f4df50b4c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:50.793062 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a013796f-23fa-4151-8d08-418f4df50b4c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:50.897057 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-d9e9fbfd-6336-4e5e-af82-f843db1ced84 req-8b8225bf-27c3-4ab4-9bc3-cd9d86edc940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7bc682-05a8-4269-a1ce-afeef9aab527", "name": "network-vif-plugged", "status": "completed", "tag": "44c89579-996d-44c2-b42b-7b85bf9483c0"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:50.916399 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-d9e9fbfd-6336-4e5e-af82-f843db1ced84 req-8b8225bf-27c3-4ab4-9bc3-cd9d86edc940 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:50.916841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-d9e9fbfd-6336-4e5e-af82-f843db1ced84 req-8b8225bf-27c3-4ab4-9bc3-cd9d86edc940 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:50.932778 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-d9e9fbfd-6336-4e5e-af82-f843db1ced84 req-8b8225bf-27c3-4ab4-9bc3-cd9d86edc940 service nova] Creating event network-vif-plugged:44c89579-996d-44c2-b42b-7b85bf9483c0 for instance bc7bc682-05a8-4269-a1ce-afeef9aab527 on hv-cinder-84684 Jun 28 03:19:50.938421 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-d9e9fbfd-6336-4e5e-af82-f843db1ced84 req-8b8225bf-27c3-4ab4-9bc3-cd9d86edc940 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044912 Jun 28 03:19:50.939035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 134/269] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:19:51.012099 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a013796f-23fa-4151-8d08-418f4df50b4c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:51.030433 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a013796f-23fa-4151-8d08-418f4df50b4c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:51.032548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a013796f-23fa-4151-8d08-418f4df50b4c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:51.034099 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a013796f-23fa-4151-8d08-418f4df50b4c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.263143 Jun 28 03:19:51.034733 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 136/270] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:19:50 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:19:51.085754 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-df6e9702-805d-446f-84a2-b78cb72a1a80 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:51.086484 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-df6e9702-805d-446f-84a2-b78cb72a1a80 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:51.093142 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-df6e9702-805d-446f-84a2-b78cb72a1a80 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:51.093589 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-df6e9702-805d-446f-84a2-b78cb72a1a80 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:51.094348 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-df6e9702-805d-446f-84a2-b78cb72a1a80 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:51.094941 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-df6e9702-805d-446f-84a2-b78cb72a1a80 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:51.257720 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-df6e9702-805d-446f-84a2-b78cb72a1a80 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:51.267478 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-df6e9702-805d-446f-84a2-b78cb72a1a80 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1313 microversion: 2.1 time: 0.186306 Jun 28 03:19:51.268184 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 135/271] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:51 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:51.378468 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8facc7bd-c1dd-45fb-aa3b-d9894a33da36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:51.379243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8facc7bd-c1dd-45fb-aa3b-d9894a33da36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:51.386259 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8facc7bd-c1dd-45fb-aa3b-d9894a33da36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:51.386259 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8facc7bd-c1dd-45fb-aa3b-d9894a33da36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:51.387191 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8facc7bd-c1dd-45fb-aa3b-d9894a33da36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:51.387618 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8facc7bd-c1dd-45fb-aa3b-d9894a33da36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:51.492982 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8facc7bd-c1dd-45fb-aa3b-d9894a33da36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:51.503906 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8facc7bd-c1dd-45fb-aa3b-d9894a33da36 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1300 microversion: 2.1 time: 0.129160 Jun 28 03:19:51.505043 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 137/272] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:51 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1300 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:51.777324 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3f738e2d-d1e6-4e96-afd4-b4976b447740 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:51.778114 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-3f738e2d-d1e6-4e96-afd4-b4976b447740 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:51.785538 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3f738e2d-d1e6-4e96-afd4-b4976b447740 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:51.786026 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3f738e2d-d1e6-4e96-afd4-b4976b447740 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:51.786798 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3f738e2d-d1e6-4e96-afd4-b4976b447740 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:51.787231 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3f738e2d-d1e6-4e96-afd4-b4976b447740 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:51.943824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-3f738e2d-d1e6-4e96-afd4-b4976b447740 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:51.953038 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3f738e2d-d1e6-4e96-afd4-b4976b447740 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1321 microversion: 2.1 time: 0.179612 Jun 28 03:19:51.953652 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 136/273] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:51 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:52.053688 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-65b6c2a0-91b8-4666-a801-ed8917882b80 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:52.054261 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-65b6c2a0-91b8-4666-a801-ed8917882b80 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:52.061377 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65b6c2a0-91b8-4666-a801-ed8917882b80 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:52.061821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65b6c2a0-91b8-4666-a801-ed8917882b80 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:52.062594 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65b6c2a0-91b8-4666-a801-ed8917882b80 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:52.063028 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65b6c2a0-91b8-4666-a801-ed8917882b80 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:52.203735 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-65b6c2a0-91b8-4666-a801-ed8917882b80 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:52.213992 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-65b6c2a0-91b8-4666-a801-ed8917882b80 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:52.216078 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-65b6c2a0-91b8-4666-a801-ed8917882b80 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:52.217340 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-65b6c2a0-91b8-4666-a801-ed8917882b80 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.168177 Jun 28 03:19:52.217902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 138/274] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:19:52 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:19:52.284544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ebc5ff1b-2c9c-44ab-bd77-6dcc01f18e92 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:52.285725 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ebc5ff1b-2c9c-44ab-bd77-6dcc01f18e92 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:52.295284 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ebc5ff1b-2c9c-44ab-bd77-6dcc01f18e92 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:52.295740 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ebc5ff1b-2c9c-44ab-bd77-6dcc01f18e92 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:52.296545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ebc5ff1b-2c9c-44ab-bd77-6dcc01f18e92 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:52.296982 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ebc5ff1b-2c9c-44ab-bd77-6dcc01f18e92 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:52.465713 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ebc5ff1b-2c9c-44ab-bd77-6dcc01f18e92 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:52.474319 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ebc5ff1b-2c9c-44ab-bd77-6dcc01f18e92 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1313 microversion: 2.1 time: 0.193613 Jun 28 03:19:52.474921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 137/275] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:52 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:52.521675 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1fef2218-9366-409d-9f29-1383bc65c508 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:52.522943 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1fef2218-9366-409d-9f29-1383bc65c508 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:52.529476 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1fef2218-9366-409d-9f29-1383bc65c508 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:52.530183 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1fef2218-9366-409d-9f29-1383bc65c508 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:52.531546 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1fef2218-9366-409d-9f29-1383bc65c508 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:52.531977 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1fef2218-9366-409d-9f29-1383bc65c508 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:52.584914 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1fef2218-9366-409d-9f29-1383bc65c508 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:52.585602 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1fef2218-9366-409d-9f29-1383bc65c508 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:52.586063 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-1fef2218-9366-409d-9f29-1383bc65c508 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lazy-loading 'fault' on Instance uuid a35380f6-a737-4573-af26-5e18f9cd0175 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:19:52.640782 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1fef2218-9366-409d-9f29-1383bc65c508 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2081ae8cb02e4a62b716c58aa2ed1ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d5bf71f605c4d65af4829f5e403a2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:52.648386 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1fef2218-9366-409d-9f29-1383bc65c508 tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 200 len: 1305 microversion: 2.1 time: 0.131042 Jun 28 03:19:52.648965 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 139/276] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:52 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 1305 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:52.969894 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9f34e9d5-0169-4e9e-a21f-fae57d7120dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:52.970599 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-9f34e9d5-0169-4e9e-a21f-fae57d7120dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:52.977277 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9f34e9d5-0169-4e9e-a21f-fae57d7120dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:52.977805 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9f34e9d5-0169-4e9e-a21f-fae57d7120dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:52.978652 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9f34e9d5-0169-4e9e-a21f-fae57d7120dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:52.979299 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9f34e9d5-0169-4e9e-a21f-fae57d7120dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:53.126252 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9f34e9d5-0169-4e9e-a21f-fae57d7120dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:53.134468 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-9f34e9d5-0169-4e9e-a21f-fae57d7120dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1516 microversion: 2.1 time: 0.168700 Jun 28 03:19:53.135036 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 138/277] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:52 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:53.151899 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a52ab62a-93c6-4bf2-9e16-0e57a389b9b5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:53.152903 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a52ab62a-93c6-4bf2-9e16-0e57a389b9b5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:53.155212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=18 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:53.163436 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a52ab62a-93c6-4bf2-9e16-0e57a389b9b5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:53.163967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a52ab62a-93c6-4bf2-9e16-0e57a389b9b5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:53.165036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a52ab62a-93c6-4bf2-9e16-0e57a389b9b5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:53.165521 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a52ab62a-93c6-4bf2-9e16-0e57a389b9b5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:53.194940 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-a52ab62a-93c6-4bf2-9e16-0e57a389b9b5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lazy-loading 'flavor' on Instance uuid 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:19:53.236189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6dd1a9d3-0ae7-4eda-9857-8dc6d4c99cc9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:53.236999 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6dd1a9d3-0ae7-4eda-9857-8dc6d4c99cc9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:53.243792 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6dd1a9d3-0ae7-4eda-9857-8dc6d4c99cc9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:53.244426 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6dd1a9d3-0ae7-4eda-9857-8dc6d4c99cc9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:53.245495 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6dd1a9d3-0ae7-4eda-9857-8dc6d4c99cc9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:53.246357 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6dd1a9d3-0ae7-4eda-9857-8dc6d4c99cc9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:53.372116 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a52ab62a-93c6-4bf2-9e16-0e57a389b9b5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "POST /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e/action" status: 200 len: 32 microversion: 2.1 time: 0.216504 Jun 28 03:19:53.372116 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 140/278] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:19:53 2022] POST /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 03:19:53.389630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d2b186ea-83a8-467c-8455-89e73dbc68dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:53.390483 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d2b186ea-83a8-467c-8455-89e73dbc68dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:53.401053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d2b186ea-83a8-467c-8455-89e73dbc68dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:53.401848 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d2b186ea-83a8-467c-8455-89e73dbc68dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:53.402900 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d2b186ea-83a8-467c-8455-89e73dbc68dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:53.403661 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d2b186ea-83a8-467c-8455-89e73dbc68dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:53.613762 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d2b186ea-83a8-467c-8455-89e73dbc68dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:53.622498 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d2b186ea-83a8-467c-8455-89e73dbc68dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.249728 Jun 28 03:19:53.623302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 141/279] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:53 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:53.629140 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6958179f-17cc-4228-9091-3d0c509c29c3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:53.633736 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6958179f-17cc-4228-9091-3d0c509c29c3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:53.639645 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6958179f-17cc-4228-9091-3d0c509c29c3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:53.640175 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6958179f-17cc-4228-9091-3d0c509c29c3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:53.641005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6958179f-17cc-4228-9091-3d0c509c29c3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:53.641491 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6958179f-17cc-4228-9091-3d0c509c29c3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:53.674198 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6dd1a9d3-0ae7-4eda-9857-8dc6d4c99cc9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:53.690066 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6dd1a9d3-0ae7-4eda-9857-8dc6d4c99cc9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:53.692977 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6dd1a9d3-0ae7-4eda-9857-8dc6d4c99cc9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:53.694334 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6dd1a9d3-0ae7-4eda-9857-8dc6d4c99cc9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.462431 Jun 28 03:19:53.695017 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 139/280] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:19:53 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:19:53.713542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8c34cbb8-178f-4c4d-9638-7977b47b4adf tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:53.715745 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-8c34cbb8-178f-4c4d-9638-7977b47b4adf tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] [instance: a35380f6-a737-4573-af26-5e18f9cd0175] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:53.733295 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c34cbb8-178f-4c4d-9638-7977b47b4adf tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:53.734086 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c34cbb8-178f-4c4d-9638-7977b47b4adf tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:53.734867 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c34cbb8-178f-4c4d-9638-7977b47b4adf tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:53.735298 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c34cbb8-178f-4c4d-9638-7977b47b4adf tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:53.772431 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-8c34cbb8-178f-4c4d-9638-7977b47b4adf tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] HTTP exception thrown: Instance a35380f6-a737-4573-af26-5e18f9cd0175 could not be found. Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8c34cbb8-178f-4c4d-9638-7977b47b4adf tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Request method failure captured: Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 HTTP/1.1 Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunM2ULSelYhqeaaBL73Sbq4ePy6Wym6vRDFYbjEjetdcrW3JbKjsBwootOogNBr0qXW_Rt2CY6dOfFQrcq3DeMqtJcAreLsQdYTy4XaNMUFXxPU6lIHMi0qHOe7gb2AQBPqmxU7XbYpqCYkjoJMGANbCqRnleNS3XfOTzvGquSDuVvI Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 0d5bf71f605c4d65af4829f5e403a2a7 Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-VolumesNegativeTest-1679629421 Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:19:53.774164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:19:53.775542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0d5bf71f605c4d65af4829f5e403a2a7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0d5bf71f605c4d65af4829f5e403a2a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d5bf71f605c4d65af4829f5e403a2a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0d5bf71f605c4d65af4829f5e403a2a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:19:53.775542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-VolumesNegativeTest-1679629421 Jun 28 03:19:53.775542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 0d5bf71f605c4d65af4829f5e403a2a7 Jun 28 03:19:53.775542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-VolumesNegativeTest-1679629421 Jun 28 03:19:53.775542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-VolumesNegativeTest-1679629421-project Jun 28 03:19:53.775542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:19:53.775542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:19:53.775542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 2081ae8cb02e4a62b716c58aa2ed1ac1 Jun 28 03:19:53.775542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-VolumesNegativeTest-1679629421-project Jun 28 03:19:53.775542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:19:53.775542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance a35380f6-a737-4573-af26-5e18f9cd0175 could not be found. Jun 28 03:19:53.775542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': 'a35380f6-a737-4573-af26-5e18f9cd0175'} Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a35380f6-a737-4573-af26-5e18f9cd0175 could not be found. Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:19:53.776744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a35380f6-a737-4573-af26-5e18f9cd0175 could not be found. Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a35380f6-a737-4573-af26-5e18f9cd0175 could not be found. Jun 28 03:19:53.778196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:19:53.779364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8c34cbb8-178f-4c4d-9638-7977b47b4adf tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] Returning 404 to user: Instance a35380f6-a737-4573-af26-5e18f9cd0175 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:19:53.779364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-8c34cbb8-178f-4c4d-9638-7977b47b4adf tempest-VolumesNegativeTest-1679629421 tempest-VolumesNegativeTest-1679629421-project] 10.222.0.44 "GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175" status: 404 len: 111 microversion: 2.1 time: 0.079543 Jun 28 03:19:53.779364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 140/281] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:53 2022] GET /compute/v2.1/servers/a35380f6-a737-4573-af26-5e18f9cd0175 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:19:53.878613 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6958179f-17cc-4228-9091-3d0c509c29c3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:53.887585 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6958179f-17cc-4228-9091-3d0c509c29c3 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1313 microversion: 2.1 time: 0.262067 Jun 28 03:19:53.888255 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 142/282] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:53 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:54.640087 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3d6bd418-4c40-4ffb-84f3-91cc6cb05c0a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:54.641352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-3d6bd418-4c40-4ffb-84f3-91cc6cb05c0a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:54.649215 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3d6bd418-4c40-4ffb-84f3-91cc6cb05c0a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:54.649758 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3d6bd418-4c40-4ffb-84f3-91cc6cb05c0a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:54.650591 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3d6bd418-4c40-4ffb-84f3-91cc6cb05c0a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:54.651116 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3d6bd418-4c40-4ffb-84f3-91cc6cb05c0a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:54.716551 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e881d082-0fac-44a1-baaf-36f64b6cc6a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:54.717813 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e881d082-0fac-44a1-baaf-36f64b6cc6a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:54.726510 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e881d082-0fac-44a1-baaf-36f64b6cc6a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:54.726948 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e881d082-0fac-44a1-baaf-36f64b6cc6a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:54.727714 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e881d082-0fac-44a1-baaf-36f64b6cc6a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:54.728225 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e881d082-0fac-44a1-baaf-36f64b6cc6a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:54.952634 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-3d6bd418-4c40-4ffb-84f3-91cc6cb05c0a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:54.961983 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3d6bd418-4c40-4ffb-84f3-91cc6cb05c0a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.326363 Jun 28 03:19:54.962666 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 141/283] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:54 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:54.968126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-74f811c3-77ca-4264-acfb-bf8129aa66b1 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:54.969211 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-74f811c3-77ca-4264-acfb-bf8129aa66b1 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:54.978159 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-74f811c3-77ca-4264-acfb-bf8129aa66b1 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:54.978963 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-74f811c3-77ca-4264-acfb-bf8129aa66b1 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:54.979981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-74f811c3-77ca-4264-acfb-bf8129aa66b1 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:54.980676 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-74f811c3-77ca-4264-acfb-bf8129aa66b1 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:55.150490 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e881d082-0fac-44a1-baaf-36f64b6cc6a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:55.159416 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e881d082-0fac-44a1-baaf-36f64b6cc6a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:55.160929 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e881d082-0fac-44a1-baaf-36f64b6cc6a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:55.162097 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e881d082-0fac-44a1-baaf-36f64b6cc6a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.449981 Jun 28 03:19:55.162843 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 143/284] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:19:54 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:19:55.207574 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-74f811c3-77ca-4264-acfb-bf8129aa66b1 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:55.215885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-74f811c3-77ca-4264-acfb-bf8129aa66b1 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1497 microversion: 2.1 time: 0.251761 Jun 28 03:19:55.216859 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 142/285] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:54 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1497 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:55.857821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-95327739-f95b-4bc3-a395-2f9160eb7d1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:55.859431 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-95327739-f95b-4bc3-a395-2f9160eb7d1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:55.869868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95327739-f95b-4bc3-a395-2f9160eb7d1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:55.870520 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95327739-f95b-4bc3-a395-2f9160eb7d1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:55.872735 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95327739-f95b-4bc3-a395-2f9160eb7d1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:55.873303 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95327739-f95b-4bc3-a395-2f9160eb7d1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:55.908345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-95327739-f95b-4bc3-a395-2f9160eb7d1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:19:55.982759 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ead1e5fd-0268-4cb9-9d0f-adc538c70a3f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:55.983379 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ead1e5fd-0268-4cb9-9d0f-adc538c70a3f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:55.991074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ead1e5fd-0268-4cb9-9d0f-adc538c70a3f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:55.991866 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ead1e5fd-0268-4cb9-9d0f-adc538c70a3f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:55.992863 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ead1e5fd-0268-4cb9-9d0f-adc538c70a3f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:55.993312 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ead1e5fd-0268-4cb9-9d0f-adc538c70a3f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:56.156964 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-95327739-f95b-4bc3-a395-2f9160eb7d1c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 204 len: 0 microversion: 2.1 time: 0.304670 Jun 28 03:19:56.157886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 144/286] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:19:55 2022] DELETE /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:19:56.167345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4e663f35-5f07-4862-968e-65a70b2ac18c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:56.169010 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4e663f35-5f07-4862-968e-65a70b2ac18c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:56.176299 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e663f35-5f07-4862-968e-65a70b2ac18c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:56.176735 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e663f35-5f07-4862-968e-65a70b2ac18c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:56.177523 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e663f35-5f07-4862-968e-65a70b2ac18c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:56.177956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e663f35-5f07-4862-968e-65a70b2ac18c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:56.191847 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ead1e5fd-0268-4cb9-9d0f-adc538c70a3f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:56.200526 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ead1e5fd-0268-4cb9-9d0f-adc538c70a3f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.224141 Jun 28 03:19:56.201327 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 143/287] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:55 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:19:56.217251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-820df64c-354b-45dc-a642-2cb4bf60ebda tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:56.217866 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-820df64c-354b-45dc-a642-2cb4bf60ebda tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:56.224568 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-820df64c-354b-45dc-a642-2cb4bf60ebda tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:56.225099 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-820df64c-354b-45dc-a642-2cb4bf60ebda tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:56.226313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-820df64c-354b-45dc-a642-2cb4bf60ebda tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:56.226944 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-820df64c-354b-45dc-a642-2cb4bf60ebda tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:56.390830 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4e663f35-5f07-4862-968e-65a70b2ac18c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:56.399317 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4e663f35-5f07-4862-968e-65a70b2ac18c tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1503 microversion: 2.1 time: 0.236517 Jun 28 03:19:56.400634 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 145/288] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:56 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:19:56.414432 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-820df64c-354b-45dc-a642-2cb4bf60ebda tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:56.423795 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-820df64c-354b-45dc-a642-2cb4bf60ebda tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:56.425304 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-820df64c-354b-45dc-a642-2cb4bf60ebda tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:56.426453 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-820df64c-354b-45dc-a642-2cb4bf60ebda tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.224156 Jun 28 03:19:56.427001 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 144/289] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:19:56 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:19:57.225209 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b29ebf54-151e-43ce-bdb1-0c7638c636a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:57.225819 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b29ebf54-151e-43ce-bdb1-0c7638c636a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:57.232861 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b29ebf54-151e-43ce-bdb1-0c7638c636a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:57.233300 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b29ebf54-151e-43ce-bdb1-0c7638c636a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:57.234692 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b29ebf54-151e-43ce-bdb1-0c7638c636a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:57.235428 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b29ebf54-151e-43ce-bdb1-0c7638c636a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:57.394094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b29ebf54-151e-43ce-bdb1-0c7638c636a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:57.401923 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b29ebf54-151e-43ce-bdb1-0c7638c636a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.186765 Jun 28 03:19:57.403318 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 146/290] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:57 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:57.417562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-34432d34-079c-48a5-ab95-ec6acf10259b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:57.418657 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-34432d34-079c-48a5-ab95-ec6acf10259b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:57.421200 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:57.427135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-34432d34-079c-48a5-ab95-ec6acf10259b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:57.427578 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-34432d34-079c-48a5-ab95-ec6acf10259b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:57.428371 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-34432d34-079c-48a5-ab95-ec6acf10259b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:57.428805 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-34432d34-079c-48a5-ab95-ec6acf10259b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:57.445927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-44685003-ee9d-4464-a2b1-3a6263878e9a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:57.446527 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-44685003-ee9d-4464-a2b1-3a6263878e9a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:57.453195 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44685003-ee9d-4464-a2b1-3a6263878e9a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:57.453633 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44685003-ee9d-4464-a2b1-3a6263878e9a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:57.454415 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44685003-ee9d-4464-a2b1-3a6263878e9a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:57.454832 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44685003-ee9d-4464-a2b1-3a6263878e9a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:57.664120 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-34432d34-079c-48a5-ab95-ec6acf10259b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:57.672096 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-44685003-ee9d-4464-a2b1-3a6263878e9a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:57.674755 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:57.683833 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-44685003-ee9d-4464-a2b1-3a6263878e9a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:57.685552 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-44685003-ee9d-4464-a2b1-3a6263878e9a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:57.686987 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-44685003-ee9d-4464-a2b1-3a6263878e9a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.244981 Jun 28 03:19:57.695973 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-34432d34-079c-48a5-ab95-ec6acf10259b tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1503 microversion: 2.1 time: 0.282120 Jun 28 03:19:57.696539 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 147/291] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:19:57 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:19:57.696651 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 145/292] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:57 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:58.419488 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3efe52e6-bc56-4b3d-a712-9a708a087d8f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:58.420133 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-3efe52e6-bc56-4b3d-a712-9a708a087d8f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:58.426913 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3efe52e6-bc56-4b3d-a712-9a708a087d8f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:58.427299 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3efe52e6-bc56-4b3d-a712-9a708a087d8f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:58.428272 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3efe52e6-bc56-4b3d-a712-9a708a087d8f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:58.429045 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3efe52e6-bc56-4b3d-a712-9a708a087d8f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:58.502491 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-8de55726-ff9a-4b8f-a683-bdcbeea3bf34 req-ccd89130-9b56-4613-a312-c2b155d89ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc7bc682-05a8-4269-a1ce-afeef9aab527", "name": "network-vif-deleted", "tag": "44c89579-996d-44c2-b42b-7b85bf9483c0"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:19:58.521680 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-8de55726-ff9a-4b8f-a683-bdcbeea3bf34 req-ccd89130-9b56-4613-a312-c2b155d89ca4 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:58.524116 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-8de55726-ff9a-4b8f-a683-bdcbeea3bf34 req-ccd89130-9b56-4613-a312-c2b155d89ca4 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:58.540393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-8de55726-ff9a-4b8f-a683-bdcbeea3bf34 req-ccd89130-9b56-4613-a312-c2b155d89ca4 service nova] Creating event network-vif-deleted:44c89579-996d-44c2-b42b-7b85bf9483c0 for instance bc7bc682-05a8-4269-a1ce-afeef9aab527 on hv-cinder-84684 Jun 28 03:19:58.552749 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-8de55726-ff9a-4b8f-a683-bdcbeea3bf34 req-ccd89130-9b56-4613-a312-c2b155d89ca4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057914 Jun 28 03:19:58.553954 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 148/293] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:19:58.629829 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-3efe52e6-bc56-4b3d-a712-9a708a087d8f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:58.641321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3efe52e6-bc56-4b3d-a712-9a708a087d8f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.225714 Jun 28 03:19:58.642323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 146/294] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:58 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:58.705478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0a8697b6-66b5-47b3-83dc-bb4978df8931 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:58.706835 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0a8697b6-66b5-47b3-83dc-bb4978df8931 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:58.719796 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b589dc04-fe10-47f8-8c04-f7ed9964f797 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:58.720753 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b589dc04-fe10-47f8-8c04-f7ed9964f797 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:58.724299 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0a8697b6-66b5-47b3-83dc-bb4978df8931 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:58.725146 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0a8697b6-66b5-47b3-83dc-bb4978df8931 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:58.727155 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0a8697b6-66b5-47b3-83dc-bb4978df8931 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:58.729159 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0a8697b6-66b5-47b3-83dc-bb4978df8931 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:58.744606 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b589dc04-fe10-47f8-8c04-f7ed9964f797 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:58.745283 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b589dc04-fe10-47f8-8c04-f7ed9964f797 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:58.746388 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b589dc04-fe10-47f8-8c04-f7ed9964f797 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:58.746955 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b589dc04-fe10-47f8-8c04-f7ed9964f797 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:58.787318 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b589dc04-fe10-47f8-8c04-f7ed9964f797 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:58.788171 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b589dc04-fe10-47f8-8c04-f7ed9964f797 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:58.788813 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.objects.instance [None req-b589dc04-fe10-47f8-8c04-f7ed9964f797 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lazy-loading 'fault' on Instance uuid bc7bc682-05a8-4269-a1ce-afeef9aab527 {{(pid=117681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:19:58.848977 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b589dc04-fe10-47f8-8c04-f7ed9964f797 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ffe193c62664564b930b6505754526b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2443fc439de4514badcb369d67462b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:58.859441 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b589dc04-fe10-47f8-8c04-f7ed9964f797 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 200 len: 1303 microversion: 2.1 time: 0.148772 Jun 28 03:19:58.864570 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 147/295] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:58 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 1303 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:19:58.909774 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0a8697b6-66b5-47b3-83dc-bb4978df8931 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:58.918765 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0a8697b6-66b5-47b3-83dc-bb4978df8931 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:58.920289 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0a8697b6-66b5-47b3-83dc-bb4978df8931 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:58.921454 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0a8697b6-66b5-47b3-83dc-bb4978df8931 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.220680 Jun 28 03:19:58.921994 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 149/296] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:19:58 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:19:59.664346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-579454a5-f3c7-4806-804b-6420cd6131a5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:59.665614 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-579454a5-f3c7-4806-804b-6420cd6131a5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:59.694802 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-579454a5-f3c7-4806-804b-6420cd6131a5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:59.695257 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-579454a5-f3c7-4806-804b-6420cd6131a5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:59.696031 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-579454a5-f3c7-4806-804b-6420cd6131a5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:59.696511 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-579454a5-f3c7-4806-804b-6420cd6131a5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:59.709242 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:19:59.859028 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-579454a5-f3c7-4806-804b-6420cd6131a5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:19:59.867274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-579454a5-f3c7-4806-804b-6420cd6131a5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.209876 Jun 28 03:19:59.868090 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 148/297] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:59 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:19:59.880907 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-133e97bb-ca9b-4531-a55d-5a7f0bf512e6 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:59.882190 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-133e97bb-ca9b-4531-a55d-5a7f0bf512e6 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] [instance: bc7bc682-05a8-4269-a1ce-afeef9aab527] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:59.889205 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-133e97bb-ca9b-4531-a55d-5a7f0bf512e6 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:59.889749 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-133e97bb-ca9b-4531-a55d-5a7f0bf512e6 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:59.890521 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-133e97bb-ca9b-4531-a55d-5a7f0bf512e6 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:59.890945 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-133e97bb-ca9b-4531-a55d-5a7f0bf512e6 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:59.905336 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-133e97bb-ca9b-4531-a55d-5a7f0bf512e6 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] HTTP exception thrown: Instance bc7bc682-05a8-4269-a1ce-afeef9aab527 could not be found. Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-133e97bb-ca9b-4531-a55d-5a7f0bf512e6 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Request method failure captured: Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 HTTP/1.1 Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunMekB_acw4AgXheueQAajNcG3uGp1FTGJL-LmrbKoUED7tXz3AAmo63V9_1jIBRc3vahRnq3qj3SmGSnH9343tdND3PylHzJdIQJQBSTPYPkqGRHLSvYAjKvE6NdbhA-28VPMbvCHsOurqn2P0c3KoRkfHyAxNUnmnQvi3R9_K5IQA Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: f2443fc439de4514badcb369d67462b9 Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesActionsTest-917178158 Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:19:59.906980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:19:59.908297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f2443fc439de4514badcb369d67462b9", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f2443fc439de4514badcb369d67462b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f2443fc439de4514badcb369d67462b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f2443fc439de4514badcb369d67462b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:19:59.908297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesActionsTest-917178158 Jun 28 03:19:59.908297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: f2443fc439de4514badcb369d67462b9 Jun 28 03:19:59.908297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesActionsTest-917178158 Jun 28 03:19:59.908297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesActionsTest-917178158-project Jun 28 03:19:59.908297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:19:59.908297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:19:59.908297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 7ffe193c62664564b930b6505754526b Jun 28 03:19:59.908297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesActionsTest-917178158-project Jun 28 03:19:59.908297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:19:59.908297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance bc7bc682-05a8-4269-a1ce-afeef9aab527 could not be found. Jun 28 03:19:59.908297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': 'bc7bc682-05a8-4269-a1ce-afeef9aab527'} Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc7bc682-05a8-4269-a1ce-afeef9aab527 could not be found. Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:19:59.909030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc7bc682-05a8-4269-a1ce-afeef9aab527 could not be found. Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc7bc682-05a8-4269-a1ce-afeef9aab527 could not be found. Jun 28 03:19:59.910787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:19:59.911848 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-133e97bb-ca9b-4531-a55d-5a7f0bf512e6 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] Returning 404 to user: Instance bc7bc682-05a8-4269-a1ce-afeef9aab527 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:19:59.911848 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-133e97bb-ca9b-4531-a55d-5a7f0bf512e6 tempest-VolumesActionsTest-917178158 tempest-VolumesActionsTest-917178158-project] 10.222.0.44 "GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527" status: 404 len: 111 microversion: 2.1 time: 0.031448 Jun 28 03:19:59.911848 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 150/298] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:19:59 2022] GET /compute/v2.1/servers/bc7bc682-05a8-4269-a1ce-afeef9aab527 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:19:59.940064 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ed0e89dd-3376-4e06-8abd-edb98f83f4e4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:19:59.940700 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ed0e89dd-3376-4e06-8abd-edb98f83f4e4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:19:59.947444 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ed0e89dd-3376-4e06-8abd-edb98f83f4e4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:59.947877 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ed0e89dd-3376-4e06-8abd-edb98f83f4e4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:19:59.948669 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ed0e89dd-3376-4e06-8abd-edb98f83f4e4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:19:59.949147 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ed0e89dd-3376-4e06-8abd-edb98f83f4e4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:00.174190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ed0e89dd-3376-4e06-8abd-edb98f83f4e4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:00.195893 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ed0e89dd-3376-4e06-8abd-edb98f83f4e4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:00.198722 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ed0e89dd-3376-4e06-8abd-edb98f83f4e4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:00.200943 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ed0e89dd-3376-4e06-8abd-edb98f83f4e4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.264915 Jun 28 03:20:00.201519 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 149/299] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:19:59 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:00.891845 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7a0e9a29-17a7-48e5-9fd2-f4ae7b907fc9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:00.892478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7a0e9a29-17a7-48e5-9fd2-f4ae7b907fc9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:00.900099 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7a0e9a29-17a7-48e5-9fd2-f4ae7b907fc9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:00.900698 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7a0e9a29-17a7-48e5-9fd2-f4ae7b907fc9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:00.901526 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7a0e9a29-17a7-48e5-9fd2-f4ae7b907fc9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:00.902612 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7a0e9a29-17a7-48e5-9fd2-f4ae7b907fc9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:00.958702 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ce01b9ba-3065-4fa6-b5ea-86aa1a268d69 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Action: 'create', calling method: .version_select at 0x7f53f1c354c0>, body: {"keypair": {"name": "tempest-keypair-748331024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBApWl9Y5nYL8fNFQ6wKdzO1w7PUI2bg0ELY+bjkJHY/p78UQW7WXGW7wl+KqbzioRs3LhPzRYaJDZPOArsksmJs5ciJbnCiSTDm2ICkHE/D7mEWuAwWvYxYHVGwrYzIUw=="}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:00.974186 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-ce01b9ba-3065-4fa6-b5ea-86aa1a268d69 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for project 63f6b05085584fd5beecbe54c7251525. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:20:00.978799 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-ce01b9ba-3065-4fa6-b5ea-86aa1a268d69 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for user 4181737f6f2348d2906aea642b8598f7 and project 63f6b05085584fd5beecbe54c7251525. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:20:01.018564 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ce01b9ba-3065-4fa6-b5ea-86aa1a268d69 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063617 Jun 28 03:20:01.019293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 150/300] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 28 03:20:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:20:01.077734 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7a0e9a29-17a7-48e5-9fd2-f4ae7b907fc9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:01.085522 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7a0e9a29-17a7-48e5-9fd2-f4ae7b907fc9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.197404 Jun 28 03:20:01.086174 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 151/301] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:00 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:20:01.223068 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6c909c74-fa4f-430c-b396-f8e1cca5044a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:01.223405 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6c909c74-fa4f-430c-b396-f8e1cca5044a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:01.241486 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6c909c74-fa4f-430c-b396-f8e1cca5044a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:01.242255 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6c909c74-fa4f-430c-b396-f8e1cca5044a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:01.243729 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6c909c74-fa4f-430c-b396-f8e1cca5044a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:01.245489 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6c909c74-fa4f-430c-b396-f8e1cca5044a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:01.448121 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6c909c74-fa4f-430c-b396-f8e1cca5044a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:01.459662 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6c909c74-fa4f-430c-b396-f8e1cca5044a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:01.461153 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6c909c74-fa4f-430c-b396-f8e1cca5044a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:01.462323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6c909c74-fa4f-430c-b396-f8e1cca5044a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.244921 Jun 28 03:20:01.462875 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 151/302] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:01 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:02.103364 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b9c3994c-a95d-41f8-841b-b587b54270a4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:02.104072 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b9c3994c-a95d-41f8-841b-b587b54270a4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:02.111089 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9c3994c-a95d-41f8-841b-b587b54270a4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:02.111740 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9c3994c-a95d-41f8-841b-b587b54270a4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:02.112666 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9c3994c-a95d-41f8-841b-b587b54270a4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:02.113274 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9c3994c-a95d-41f8-841b-b587b54270a4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:02.283550 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b9c3994c-a95d-41f8-841b-b587b54270a4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:02.292232 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b9c3994c-a95d-41f8-841b-b587b54270a4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.193060 Jun 28 03:20:02.293335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 152/303] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:02 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:02.480876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-39280b7d-b912-4221-a6ed-eb4a71fed791 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:02.481584 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-39280b7d-b912-4221-a6ed-eb4a71fed791 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:02.488705 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-39280b7d-b912-4221-a6ed-eb4a71fed791 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:02.489120 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-39280b7d-b912-4221-a6ed-eb4a71fed791 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:02.490061 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-39280b7d-b912-4221-a6ed-eb4a71fed791 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:02.490489 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-39280b7d-b912-4221-a6ed-eb4a71fed791 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:02.663049 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-39280b7d-b912-4221-a6ed-eb4a71fed791 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:02.673643 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-39280b7d-b912-4221-a6ed-eb4a71fed791 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:02.675141 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-39280b7d-b912-4221-a6ed-eb4a71fed791 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:02.676422 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-39280b7d-b912-4221-a6ed-eb4a71fed791 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1745 microversion: 2.20 time: 0.199655 Jun 28 03:20:02.678401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 152/304] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:02 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1745 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:20:02.856324 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-52458368", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78d460e7-819f-442d-8ddd-fecab5b4b6fc"}], "security_groups": [{"name": "tempest-securitygroup--1032096595"}], "key_name": "tempest-keypair-748331024", "user_data": "}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:03.312769 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b87c0d2d-e767-4eed-b633-6ac799a908f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:03.313476 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b87c0d2d-e767-4eed-b633-6ac799a908f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:03.321729 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b87c0d2d-e767-4eed-b633-6ac799a908f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:03.322253 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b87c0d2d-e767-4eed-b633-6ac799a908f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:03.323140 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b87c0d2d-e767-4eed-b633-6ac799a908f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:03.323634 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b87c0d2d-e767-4eed-b633-6ac799a908f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:03.457459 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b87c0d2d-e767-4eed-b633-6ac799a908f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:03.465444 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b87c0d2d-e767-4eed-b633-6ac799a908f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.158898 Jun 28 03:20:03.466040 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 153/305] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:03 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:03.699182 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6989f941-5c71-42f9-8526-808d1973e9b5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:03.699860 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6989f941-5c71-42f9-8526-808d1973e9b5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:03.706238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6989f941-5c71-42f9-8526-808d1973e9b5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:03.706849 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6989f941-5c71-42f9-8526-808d1973e9b5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:03.707589 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6989f941-5c71-42f9-8526-808d1973e9b5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:03.708009 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6989f941-5c71-42f9-8526-808d1973e9b5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:03.885044 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6989f941-5c71-42f9-8526-808d1973e9b5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:03.894759 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6989f941-5c71-42f9-8526-808d1973e9b5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:03.898642 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6989f941-5c71-42f9-8526-808d1973e9b5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:03.900373 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6989f941-5c71-42f9-8526-808d1973e9b5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1745 microversion: 2.20 time: 0.207654 Jun 28 03:20:03.901447 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 154/306] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:03 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1745 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:04.483796 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-249a770d-7c40-4ead-ae66-d8cec61e4b99 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:04.484556 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-249a770d-7c40-4ead-ae66-d8cec61e4b99 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:04.491608 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-249a770d-7c40-4ead-ae66-d8cec61e4b99 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:04.492343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-249a770d-7c40-4ead-ae66-d8cec61e4b99 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:04.493304 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-249a770d-7c40-4ead-ae66-d8cec61e4b99 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:04.493883 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-249a770d-7c40-4ead-ae66-d8cec61e4b99 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:04.573096 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] validate_networks() for [('78d460e7-819f-442d-8ddd-fecab5b4b6fc', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:20:05.165154 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-249a770d-7c40-4ead-ae66-d8cec61e4b99 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:05.173875 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-249a770d-7c40-4ead-ae66-d8cec61e4b99 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.695107 Jun 28 03:20:05.174675 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 155/307] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:04 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:20:05.180469 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-3de57bfc-1b1a-44b1-b17b-eeeb42e8cb23 req-040aff95-a1b5-4df0-b51a-68c53a7d9c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f3fd86-9d6c-4d2e-8997-579c77adc3f0", "name": "network-vif-plugged", "status": "completed", "tag": "9e28a86b-c03c-4271-880f-a8d72e9df423"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:05.190379 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-3de57bfc-1b1a-44b1-b17b-eeeb42e8cb23 req-040aff95-a1b5-4df0-b51a-68c53a7d9c9f service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:05.190814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-3de57bfc-1b1a-44b1-b17b-eeeb42e8cb23 req-040aff95-a1b5-4df0-b51a-68c53a7d9c9f service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:05.203103 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-3de57bfc-1b1a-44b1-b17b-eeeb42e8cb23 req-040aff95-a1b5-4df0-b51a-68c53a7d9c9f service nova] Creating event network-vif-plugged:9e28a86b-c03c-4271-880f-a8d72e9df423 for instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 on hv-cinder-84684 Jun 28 03:20:05.208840 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-3de57bfc-1b1a-44b1-b17b-eeeb42e8cb23 req-040aff95-a1b5-4df0-b51a-68c53a7d9c9f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032760 Jun 28 03:20:05.211852 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 156/308] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:20:05.217305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-86be6e99-41bf-481b-87a6-69fb9bfa62d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:05.217986 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-86be6e99-41bf-481b-87a6-69fb9bfa62d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:05.224451 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-86be6e99-41bf-481b-87a6-69fb9bfa62d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:05.224892 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-86be6e99-41bf-481b-87a6-69fb9bfa62d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:05.225646 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-86be6e99-41bf-481b-87a6-69fb9bfa62d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:05.226067 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-86be6e99-41bf-481b-87a6-69fb9bfa62d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:05.441028 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-86be6e99-41bf-481b-87a6-69fb9bfa62d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:05.453259 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-86be6e99-41bf-481b-87a6-69fb9bfa62d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:05.454978 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-86be6e99-41bf-481b-87a6-69fb9bfa62d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:05.456302 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-86be6e99-41bf-481b-87a6-69fb9bfa62d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1740 microversion: 2.20 time: 0.242961 Jun 28 03:20:05.462065 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 157/309] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:05 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:05.551381 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:20:05.551785 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:20:05.552519 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:20:05.552956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:20:05.553522 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:20:05.564542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:05.565238 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:05.566314 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:05.566753 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:05.585944 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for project 63f6b05085584fd5beecbe54c7251525. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:20:05.590040 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for user 4181737f6f2348d2906aea642b8598f7 and project 63f6b05085584fd5beecbe54c7251525. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:20:05.601625 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:20:05.604193 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:20:05.653963 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a6cb476c-0c3a-4aeb-bc8a-5311d6611a06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.802650 Jun 28 03:20:05.654909 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 153/310] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:20:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 2804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:20:05.666325 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7e962017-2aa0-4d24-8ad6-3ba7d6b008f9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:05.667329 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7e962017-2aa0-4d24-8ad6-3ba7d6b008f9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:05.748284 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7e962017-2aa0-4d24-8ad6-3ba7d6b008f9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:05.755427 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7e962017-2aa0-4d24-8ad6-3ba7d6b008f9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1239 microversion: 2.1 time: 0.094012 Jun 28 03:20:05.755997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 158/311] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:05 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1239 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:06.191389 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8adefad3-7207-4a92-a56d-bd68c058d205 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:06.192097 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8adefad3-7207-4a92-a56d-bd68c058d205 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:06.198663 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8adefad3-7207-4a92-a56d-bd68c058d205 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:06.199461 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8adefad3-7207-4a92-a56d-bd68c058d205 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:06.200057 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8adefad3-7207-4a92-a56d-bd68c058d205 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:06.200593 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8adefad3-7207-4a92-a56d-bd68c058d205 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:06.369208 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8adefad3-7207-4a92-a56d-bd68c058d205 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:06.379521 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8adefad3-7207-4a92-a56d-bd68c058d205 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.192409 Jun 28 03:20:06.391996 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 154/312] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:06 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:06.475778 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c79b58c8-1a5e-43e8-bd41-da539a68020b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:06.476468 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c79b58c8-1a5e-43e8-bd41-da539a68020b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:06.483355 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c79b58c8-1a5e-43e8-bd41-da539a68020b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:06.484137 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c79b58c8-1a5e-43e8-bd41-da539a68020b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:06.484948 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c79b58c8-1a5e-43e8-bd41-da539a68020b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:06.485386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c79b58c8-1a5e-43e8-bd41-da539a68020b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:06.644905 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c79b58c8-1a5e-43e8-bd41-da539a68020b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:06.653739 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c79b58c8-1a5e-43e8-bd41-da539a68020b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:06.655237 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c79b58c8-1a5e-43e8-bd41-da539a68020b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:06.656461 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c79b58c8-1a5e-43e8-bd41-da539a68020b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1740 microversion: 2.20 time: 0.185406 Jun 28 03:20:06.657024 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 159/313] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:06 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:06.772411 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1b6c7e4b-3943-4232-a716-476c58e96a11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:06.773798 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1b6c7e4b-3943-4232-a716-476c58e96a11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:06.782276 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1b6c7e4b-3943-4232-a716-476c58e96a11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:06.782728 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1b6c7e4b-3943-4232-a716-476c58e96a11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:06.783514 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1b6c7e4b-3943-4232-a716-476c58e96a11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:06.783945 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1b6c7e4b-3943-4232-a716-476c58e96a11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:06.850701 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1b6c7e4b-3943-4232-a716-476c58e96a11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:06.864508 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1b6c7e4b-3943-4232-a716-476c58e96a11 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1243 microversion: 2.1 time: 0.096009 Jun 28 03:20:06.865552 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 155/314] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:06 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1243 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:07.400344 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2b595401-25e4-49cc-a520-2c28fc472c24 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:07.401078 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2b595401-25e4-49cc-a520-2c28fc472c24 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:07.408750 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2b595401-25e4-49cc-a520-2c28fc472c24 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:07.409541 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2b595401-25e4-49cc-a520-2c28fc472c24 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:07.410533 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2b595401-25e4-49cc-a520-2c28fc472c24 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:07.411029 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2b595401-25e4-49cc-a520-2c28fc472c24 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:07.566957 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2b595401-25e4-49cc-a520-2c28fc472c24 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:07.576930 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2b595401-25e4-49cc-a520-2c28fc472c24 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.183640 Jun 28 03:20:07.577516 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 160/315] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:07 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:07.674932 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-77be32a3-5d46-4250-8e20-effc3a481d5a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:07.675444 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-77be32a3-5d46-4250-8e20-effc3a481d5a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:07.681710 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77be32a3-5d46-4250-8e20-effc3a481d5a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:07.682367 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77be32a3-5d46-4250-8e20-effc3a481d5a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:07.683583 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77be32a3-5d46-4250-8e20-effc3a481d5a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:07.684344 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77be32a3-5d46-4250-8e20-effc3a481d5a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:07.823489 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-77be32a3-5d46-4250-8e20-effc3a481d5a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:07.832074 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-77be32a3-5d46-4250-8e20-effc3a481d5a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:07.833589 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-77be32a3-5d46-4250-8e20-effc3a481d5a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:07.834800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-77be32a3-5d46-4250-8e20-effc3a481d5a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1740 microversion: 2.20 time: 0.163970 Jun 28 03:20:07.835361 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 156/316] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:07 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:07.882508 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e039221a-713e-477b-ae53-00774b4c5b0d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:07.883112 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e039221a-713e-477b-ae53-00774b4c5b0d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:07.889708 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e039221a-713e-477b-ae53-00774b4c5b0d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:07.890151 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e039221a-713e-477b-ae53-00774b4c5b0d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:07.890901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e039221a-713e-477b-ae53-00774b4c5b0d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:07.891328 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e039221a-713e-477b-ae53-00774b4c5b0d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:07.973331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e039221a-713e-477b-ae53-00774b4c5b0d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:07.983282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e039221a-713e-477b-ae53-00774b4c5b0d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1243 microversion: 2.1 time: 0.104645 Jun 28 03:20:07.984216 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 161/317] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:07 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1243 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:08.601819 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a06f990a-49c9-4b76-a63b-9d6ea0896adf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:08.602792 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a06f990a-49c9-4b76-a63b-9d6ea0896adf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:08.611003 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a06f990a-49c9-4b76-a63b-9d6ea0896adf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:08.611540 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a06f990a-49c9-4b76-a63b-9d6ea0896adf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:08.612449 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a06f990a-49c9-4b76-a63b-9d6ea0896adf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:08.612827 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a06f990a-49c9-4b76-a63b-9d6ea0896adf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:08.805132 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a06f990a-49c9-4b76-a63b-9d6ea0896adf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:08.818791 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a06f990a-49c9-4b76-a63b-9d6ea0896adf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.227617 Jun 28 03:20:08.819666 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 157/318] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:08 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:08.854004 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6375d8da-5197-4362-8ac9-4933c42314b4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:08.854683 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6375d8da-5197-4362-8ac9-4933c42314b4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:08.862846 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6375d8da-5197-4362-8ac9-4933c42314b4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:08.863285 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6375d8da-5197-4362-8ac9-4933c42314b4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:08.864261 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6375d8da-5197-4362-8ac9-4933c42314b4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:08.864845 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6375d8da-5197-4362-8ac9-4933c42314b4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:09.001029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1df389ea-1c9c-489f-a1d8-0f14c3c14f77 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:09.003528 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1df389ea-1c9c-489f-a1d8-0f14c3c14f77 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:09.014946 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1df389ea-1c9c-489f-a1d8-0f14c3c14f77 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:09.015684 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1df389ea-1c9c-489f-a1d8-0f14c3c14f77 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:09.016547 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1df389ea-1c9c-489f-a1d8-0f14c3c14f77 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:09.017156 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1df389ea-1c9c-489f-a1d8-0f14c3c14f77 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:09.117734 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1df389ea-1c9c-489f-a1d8-0f14c3c14f77 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:09.126831 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1df389ea-1c9c-489f-a1d8-0f14c3c14f77 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1297 microversion: 2.1 time: 0.130512 Jun 28 03:20:09.138056 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 158/319] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:08 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1297 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:09.191719 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6375d8da-5197-4362-8ac9-4933c42314b4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:09.202315 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6375d8da-5197-4362-8ac9-4933c42314b4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:09.204298 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6375d8da-5197-4362-8ac9-4933c42314b4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:09.206921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6375d8da-5197-4362-8ac9-4933c42314b4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1740 microversion: 2.20 time: 0.355742 Jun 28 03:20:09.207779 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 162/320] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:08 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1740 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:09.836021 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3cf778a6-db8f-477e-b453-d4487fa339da tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:09.836800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3cf778a6-db8f-477e-b453-d4487fa339da tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:09.847628 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3cf778a6-db8f-477e-b453-d4487fa339da tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:09.848507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3cf778a6-db8f-477e-b453-d4487fa339da tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:09.853321 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3cf778a6-db8f-477e-b453-d4487fa339da tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:09.854363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3cf778a6-db8f-477e-b453-d4487fa339da tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:10.143729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3cf778a6-db8f-477e-b453-d4487fa339da tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:10.148222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3d49aa27-c147-4214-a2bc-4a6df2d07475 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:10.149679 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-3d49aa27-c147-4214-a2bc-4a6df2d07475 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:10.151863 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3cf778a6-db8f-477e-b453-d4487fa339da tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.319553 Jun 28 03:20:10.152925 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 159/321] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:09 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:10.164107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3d49aa27-c147-4214-a2bc-4a6df2d07475 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:10.166015 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3d49aa27-c147-4214-a2bc-4a6df2d07475 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:10.166961 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3d49aa27-c147-4214-a2bc-4a6df2d07475 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:10.169327 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3d49aa27-c147-4214-a2bc-4a6df2d07475 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:10.225809 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-df0fe42b-1701-41c6-8391-827df8904686 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:10.226406 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-df0fe42b-1701-41c6-8391-827df8904686 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:10.233009 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-df0fe42b-1701-41c6-8391-827df8904686 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:10.234032 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-df0fe42b-1701-41c6-8391-827df8904686 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:10.234966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-df0fe42b-1701-41c6-8391-827df8904686 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:10.235542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-df0fe42b-1701-41c6-8391-827df8904686 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:10.642949 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-df0fe42b-1701-41c6-8391-827df8904686 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:10.663220 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-3d49aa27-c147-4214-a2bc-4a6df2d07475 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:10.703711 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3d49aa27-c147-4214-a2bc-4a6df2d07475 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1365 microversion: 2.1 time: 0.560539 Jun 28 03:20:10.717111 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-df0fe42b-1701-41c6-8391-827df8904686 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:10.733280 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 163/322] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:10 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1365 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:10.734802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-df0fe42b-1701-41c6-8391-827df8904686 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:10.736275 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-df0fe42b-1701-41c6-8391-827df8904686 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1740 microversion: 2.20 time: 0.514353 Jun 28 03:20:10.759010 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 160/323] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:10 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1740 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:11.170573 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e22dd656-8c9b-4ee9-ae59-9113146000e9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:11.172324 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e22dd656-8c9b-4ee9-ae59-9113146000e9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:11.190017 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e22dd656-8c9b-4ee9-ae59-9113146000e9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:11.191978 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e22dd656-8c9b-4ee9-ae59-9113146000e9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:11.193186 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e22dd656-8c9b-4ee9-ae59-9113146000e9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:11.196678 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e22dd656-8c9b-4ee9-ae59-9113146000e9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:11.251826 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-bd365e10-e80d-4dce-bce1-b68c5d6e131f req-7956603c-9227-4f7b-b52f-e8b3ff4bc8fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72b33cdf-def8-4dff-a771-d3e795fa0c27", "tag": "d436dd45-4104-4290-a33b-f2fe67047429"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:11.268820 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bd365e10-e80d-4dce-bce1-b68c5d6e131f req-7956603c-9227-4f7b-b52f-e8b3ff4bc8fe service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:11.269289 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bd365e10-e80d-4dce-bce1-b68c5d6e131f req-7956603c-9227-4f7b-b52f-e8b3ff4bc8fe service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:11.303368 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-bd365e10-e80d-4dce-bce1-b68c5d6e131f req-7956603c-9227-4f7b-b52f-e8b3ff4bc8fe service nova] Creating event network-changed:d436dd45-4104-4290-a33b-f2fe67047429 for instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 on hv-cinder-84684 Jun 28 03:20:11.309449 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-bd365e10-e80d-4dce-bce1-b68c5d6e131f req-7956603c-9227-4f7b-b52f-e8b3ff4bc8fe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062004 Jun 28 03:20:11.313077 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 161/324] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:20:11.553050 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e22dd656-8c9b-4ee9-ae59-9113146000e9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:11.579576 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e22dd656-8c9b-4ee9-ae59-9113146000e9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.413389 Jun 28 03:20:11.584966 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 164/325] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:11 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:11.740041 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3709be4e-d9b6-46f4-8f14-b99bb3a6b590 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:11.740672 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3709be4e-d9b6-46f4-8f14-b99bb3a6b590 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:11.751017 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3709be4e-d9b6-46f4-8f14-b99bb3a6b590 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:11.751462 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3709be4e-d9b6-46f4-8f14-b99bb3a6b590 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:11.755134 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3709be4e-d9b6-46f4-8f14-b99bb3a6b590 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:11.764129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3709be4e-d9b6-46f4-8f14-b99bb3a6b590 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:11.765967 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6b2bbd5d-4bf5-4a60-8a3d-241ffcb9ef59 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:11.766676 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6b2bbd5d-4bf5-4a60-8a3d-241ffcb9ef59 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:11.781225 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6b2bbd5d-4bf5-4a60-8a3d-241ffcb9ef59 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:11.786163 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6b2bbd5d-4bf5-4a60-8a3d-241ffcb9ef59 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:11.787588 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6b2bbd5d-4bf5-4a60-8a3d-241ffcb9ef59 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:11.789534 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6b2bbd5d-4bf5-4a60-8a3d-241ffcb9ef59 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:12.155365 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3709be4e-d9b6-46f4-8f14-b99bb3a6b590 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:12.163370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3709be4e-d9b6-46f4-8f14-b99bb3a6b590 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1365 microversion: 2.1 time: 0.427786 Jun 28 03:20:12.177600 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 162/326] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:11 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1365 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:12.255303 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6b2bbd5d-4bf5-4a60-8a3d-241ffcb9ef59 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:12.270761 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6b2bbd5d-4bf5-4a60-8a3d-241ffcb9ef59 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:12.272767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6b2bbd5d-4bf5-4a60-8a3d-241ffcb9ef59 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:12.274124 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6b2bbd5d-4bf5-4a60-8a3d-241ffcb9ef59 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1740 microversion: 2.20 time: 0.512957 Jun 28 03:20:12.279752 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 165/327] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:11 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1740 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:20:12.601584 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0565cf05-0742-4dcf-a3c5-0fc9d4e123f1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:12.603873 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0565cf05-0742-4dcf-a3c5-0fc9d4e123f1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:12.617184 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0565cf05-0742-4dcf-a3c5-0fc9d4e123f1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:12.619389 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0565cf05-0742-4dcf-a3c5-0fc9d4e123f1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:12.624442 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0565cf05-0742-4dcf-a3c5-0fc9d4e123f1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:12.625146 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0565cf05-0742-4dcf-a3c5-0fc9d4e123f1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:12.991233 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0565cf05-0742-4dcf-a3c5-0fc9d4e123f1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:13.011454 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0565cf05-0742-4dcf-a3c5-0fc9d4e123f1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.413471 Jun 28 03:20:13.013964 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 163/328] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:12 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:13.211038 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-59cfcbb0-6c93-4ebf-9150-db27e2c403a0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:13.211699 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-59cfcbb0-6c93-4ebf-9150-db27e2c403a0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:13.229382 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-59cfcbb0-6c93-4ebf-9150-db27e2c403a0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:13.230563 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-59cfcbb0-6c93-4ebf-9150-db27e2c403a0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:13.231391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-59cfcbb0-6c93-4ebf-9150-db27e2c403a0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:13.232027 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-59cfcbb0-6c93-4ebf-9150-db27e2c403a0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:13.344183 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-45983ff1-d9d1-4fb6-9ccc-dc0088bb14d5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:13.345479 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-45983ff1-d9d1-4fb6-9ccc-dc0088bb14d5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:13.366551 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45983ff1-d9d1-4fb6-9ccc-dc0088bb14d5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:13.367302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45983ff1-d9d1-4fb6-9ccc-dc0088bb14d5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:13.368299 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45983ff1-d9d1-4fb6-9ccc-dc0088bb14d5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:13.373045 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45983ff1-d9d1-4fb6-9ccc-dc0088bb14d5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:13.913918 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-45983ff1-d9d1-4fb6-9ccc-dc0088bb14d5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:13.923592 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-45983ff1-d9d1-4fb6-9ccc-dc0088bb14d5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:13.929739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-45983ff1-d9d1-4fb6-9ccc-dc0088bb14d5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:13.934912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-45983ff1-d9d1-4fb6-9ccc-dc0088bb14d5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1740 microversion: 2.20 time: 0.607778 Jun 28 03:20:13.935566 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 164/329] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:13 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1740 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:14.029832 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-59cfcbb0-6c93-4ebf-9150-db27e2c403a0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:14.031378 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f8f15f8f-c08d-47f6-b559-01b992a57367 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:14.031990 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f8f15f8f-c08d-47f6-b559-01b992a57367 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:14.040641 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8f15f8f-c08d-47f6-b559-01b992a57367 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:14.043437 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8f15f8f-c08d-47f6-b559-01b992a57367 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:14.043605 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-59cfcbb0-6c93-4ebf-9150-db27e2c403a0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1365 microversion: 2.1 time: 0.856322 Jun 28 03:20:14.044107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 166/330] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:13 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1365 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:14.047119 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8f15f8f-c08d-47f6-b559-01b992a57367 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:14.047745 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8f15f8f-c08d-47f6-b559-01b992a57367 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:14.222155 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f8f15f8f-c08d-47f6-b559-01b992a57367 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:14.231356 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f8f15f8f-c08d-47f6-b559-01b992a57367 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.205198 Jun 28 03:20:14.234632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 165/331] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:14 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:20:14.954448 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-fa665f92-5c3e-4bf2-bb6c-77968e84356f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:14.955300 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-fa665f92-5c3e-4bf2-bb6c-77968e84356f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:14.968630 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fa665f92-5c3e-4bf2-bb6c-77968e84356f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:14.971485 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fa665f92-5c3e-4bf2-bb6c-77968e84356f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:14.972461 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fa665f92-5c3e-4bf2-bb6c-77968e84356f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:14.972987 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fa665f92-5c3e-4bf2-bb6c-77968e84356f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:15.007511 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=100 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:15.063080 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3c0e20ce-9cb0-482b-bf05-b403a34ac099 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:15.064354 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3c0e20ce-9cb0-482b-bf05-b403a34ac099 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:15.075157 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c0e20ce-9cb0-482b-bf05-b403a34ac099 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:15.078189 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c0e20ce-9cb0-482b-bf05-b403a34ac099 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:15.079287 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c0e20ce-9cb0-482b-bf05-b403a34ac099 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:15.079884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c0e20ce-9cb0-482b-bf05-b403a34ac099 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:15.317366 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-fa665f92-5c3e-4bf2-bb6c-77968e84356f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:15.326996 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3c0e20ce-9cb0-482b-bf05-b403a34ac099 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:15.327252 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-fa665f92-5c3e-4bf2-bb6c-77968e84356f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:15.333358 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-fa665f92-5c3e-4bf2-bb6c-77968e84356f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:15.337543 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-fa665f92-5c3e-4bf2-bb6c-77968e84356f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1740 microversion: 2.20 time: 0.386884 Jun 28 03:20:15.338626 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 167/332] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:14 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1740 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:15.352909 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3c0e20ce-9cb0-482b-bf05-b403a34ac099 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1365 microversion: 2.1 time: 0.296362 Jun 28 03:20:15.356436 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-26905313-5828-4210-8d11-4abe75515a3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:15.357374 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-26905313-5828-4210-8d11-4abe75515a3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:15.360051 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 166/333] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:15 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:20:15.372853 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-26905313-5828-4210-8d11-4abe75515a3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:15.373506 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-26905313-5828-4210-8d11-4abe75515a3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:15.374367 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-26905313-5828-4210-8d11-4abe75515a3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:15.375027 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-26905313-5828-4210-8d11-4abe75515a3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:15.552053 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-26905313-5828-4210-8d11-4abe75515a3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:15.562901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-26905313-5828-4210-8d11-4abe75515a3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.222779 Jun 28 03:20:15.574954 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 168/334] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:15 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:16.360051 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f14d4ee4-e638-453b-b5e2-69b6f0693c8a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:16.362275 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f14d4ee4-e638-453b-b5e2-69b6f0693c8a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:16.366392 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:16.368278 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:16.380649 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-30eb6ea9-6b6b-4a49-89e4-4357549a6c14 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:16.382203 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-30eb6ea9-6b6b-4a49-89e4-4357549a6c14 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:16.393422 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=6 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:16.396469 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f14d4ee4-e638-453b-b5e2-69b6f0693c8a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:16.397371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f14d4ee4-e638-453b-b5e2-69b6f0693c8a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:16.400325 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-30eb6ea9-6b6b-4a49-89e4-4357549a6c14 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:16.400739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f14d4ee4-e638-453b-b5e2-69b6f0693c8a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:16.401460 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f14d4ee4-e638-453b-b5e2-69b6f0693c8a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:16.402107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-30eb6ea9-6b6b-4a49-89e4-4357549a6c14 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:16.406634 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-30eb6ea9-6b6b-4a49-89e4-4357549a6c14 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:16.407455 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-30eb6ea9-6b6b-4a49-89e4-4357549a6c14 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:16.410001 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:16.681843 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-30eb6ea9-6b6b-4a49-89e4-4357549a6c14 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:16.689179 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f14d4ee4-e638-453b-b5e2-69b6f0693c8a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:16.692238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-30eb6ea9-6b6b-4a49-89e4-4357549a6c14 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1365 microversion: 2.1 time: 0.314576 Jun 28 03:20:16.692916 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 169/335] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:16 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1365 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:20:16.697751 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a35fed8c-506e-42d7-b949-ef1009385ab2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:16.698506 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a35fed8c-506e-42d7-b949-ef1009385ab2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:16.704594 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a35fed8c-506e-42d7-b949-ef1009385ab2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:16.705113 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a35fed8c-506e-42d7-b949-ef1009385ab2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:16.705941 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a35fed8c-506e-42d7-b949-ef1009385ab2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:16.706440 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a35fed8c-506e-42d7-b949-ef1009385ab2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:16.707522 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f14d4ee4-e638-453b-b5e2-69b6f0693c8a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:16.709471 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f14d4ee4-e638-453b-b5e2-69b6f0693c8a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:16.710644 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f14d4ee4-e638-453b-b5e2-69b6f0693c8a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1740 microversion: 2.20 time: 0.357397 Jun 28 03:20:16.711198 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 167/336] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:16 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:20:16.854327 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a35fed8c-506e-42d7-b949-ef1009385ab2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:16.863356 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a35fed8c-506e-42d7-b949-ef1009385ab2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.169110 Jun 28 03:20:16.864036 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 170/337] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:16 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:17.708928 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bcd6e45c-006f-44c5-8493-6b527d314d1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:17.709537 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-bcd6e45c-006f-44c5-8493-6b527d314d1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:17.717578 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bcd6e45c-006f-44c5-8493-6b527d314d1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:17.718020 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bcd6e45c-006f-44c5-8493-6b527d314d1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:17.718951 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bcd6e45c-006f-44c5-8493-6b527d314d1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:17.719532 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bcd6e45c-006f-44c5-8493-6b527d314d1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:17.729249 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ab2bbfb6-c230-49c1-9c0d-c78cbcbdfba9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:17.729987 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ab2bbfb6-c230-49c1-9c0d-c78cbcbdfba9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:17.754412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ab2bbfb6-c230-49c1-9c0d-c78cbcbdfba9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:17.755107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ab2bbfb6-c230-49c1-9c0d-c78cbcbdfba9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:17.756375 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ab2bbfb6-c230-49c1-9c0d-c78cbcbdfba9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:17.756965 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ab2bbfb6-c230-49c1-9c0d-c78cbcbdfba9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:18.089604 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-bcd6e45c-006f-44c5-8493-6b527d314d1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:18.099663 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-bcd6e45c-006f-44c5-8493-6b527d314d1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1365 microversion: 2.1 time: 0.394567 Jun 28 03:20:18.110904 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 168/338] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:17 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1365 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:18.118438 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0d6d6ece-c685-4605-a0f7-92d30bbe44a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:18.119467 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0d6d6ece-c685-4605-a0f7-92d30bbe44a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:18.120216 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ab2bbfb6-c230-49c1-9c0d-c78cbcbdfba9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:18.127112 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d6d6ece-c685-4605-a0f7-92d30bbe44a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:18.127963 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d6d6ece-c685-4605-a0f7-92d30bbe44a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:18.128967 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ab2bbfb6-c230-49c1-9c0d-c78cbcbdfba9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:18.129143 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d6d6ece-c685-4605-a0f7-92d30bbe44a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:18.129635 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d6d6ece-c685-4605-a0f7-92d30bbe44a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:18.131085 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ab2bbfb6-c230-49c1-9c0d-c78cbcbdfba9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:18.133383 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ab2bbfb6-c230-49c1-9c0d-c78cbcbdfba9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1722 microversion: 2.20 time: 0.407204 Jun 28 03:20:18.145356 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 171/339] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:17 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1722 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:20:18.342043 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0d6d6ece-c685-4605-a0f7-92d30bbe44a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:18.357063 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0d6d6ece-c685-4605-a0f7-92d30bbe44a0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.244423 Jun 28 03:20:18.357762 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 169/340] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:18 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:19.117981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-df8a2f2d-48c6-4928-b119-7287620eb86b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:19.118597 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-df8a2f2d-48c6-4928-b119-7287620eb86b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:19.126299 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-df8a2f2d-48c6-4928-b119-7287620eb86b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:19.126745 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-df8a2f2d-48c6-4928-b119-7287620eb86b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:19.128042 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-df8a2f2d-48c6-4928-b119-7287620eb86b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:19.128564 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-df8a2f2d-48c6-4928-b119-7287620eb86b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:19.154249 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8865d8a0-719c-4ff9-834e-771a1b652861 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:19.155565 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8865d8a0-719c-4ff9-834e-771a1b652861 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:19.167544 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8865d8a0-719c-4ff9-834e-771a1b652861 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:19.168771 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8865d8a0-719c-4ff9-834e-771a1b652861 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:19.169848 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8865d8a0-719c-4ff9-834e-771a1b652861 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:19.170348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8865d8a0-719c-4ff9-834e-771a1b652861 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:19.766667 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-df8a2f2d-48c6-4928-b119-7287620eb86b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:19.791193 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-df8a2f2d-48c6-4928-b119-7287620eb86b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1365 microversion: 2.1 time: 0.669899 Jun 28 03:20:19.792178 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 172/341] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:19 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1365 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:19.806395 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6fe89a43-ddac-4182-b2b9-cec0a28c9964 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:19.807036 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6fe89a43-ddac-4182-b2b9-cec0a28c9964 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:19.820318 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8865d8a0-719c-4ff9-834e-771a1b652861 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:19.828892 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8865d8a0-719c-4ff9-834e-771a1b652861 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:19.830373 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8865d8a0-719c-4ff9-834e-771a1b652861 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:19.831862 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8865d8a0-719c-4ff9-834e-771a1b652861 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1722 microversion: 2.20 time: 0.682559 Jun 28 03:20:19.844572 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fe89a43-ddac-4182-b2b9-cec0a28c9964 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:19.845077 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fe89a43-ddac-4182-b2b9-cec0a28c9964 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:19.845914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fe89a43-ddac-4182-b2b9-cec0a28c9964 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:19.846355 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fe89a43-ddac-4182-b2b9-cec0a28c9964 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:19.850962 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 170/342] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:19 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1722 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:20.029747 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6fe89a43-ddac-4182-b2b9-cec0a28c9964 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:20.039118 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6fe89a43-ddac-4182-b2b9-cec0a28c9964 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.245659 Jun 28 03:20:20.040067 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 173/343] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:19 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:20.811503 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-52c473b6-1ca4-40f0-9f84-7526fa2b6cac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:20.812107 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-52c473b6-1ca4-40f0-9f84-7526fa2b6cac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:20.815330 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:20.819939 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-52c473b6-1ca4-40f0-9f84-7526fa2b6cac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:20.820408 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-52c473b6-1ca4-40f0-9f84-7526fa2b6cac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:20.821387 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-52c473b6-1ca4-40f0-9f84-7526fa2b6cac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:20.821994 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-52c473b6-1ca4-40f0-9f84-7526fa2b6cac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:20.852849 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2c9d4042-4c4e-4a19-875f-3d208eeb906e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:20.853533 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2c9d4042-4c4e-4a19-875f-3d208eeb906e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:20.862581 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2c9d4042-4c4e-4a19-875f-3d208eeb906e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:20.863413 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2c9d4042-4c4e-4a19-875f-3d208eeb906e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:20.864435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2c9d4042-4c4e-4a19-875f-3d208eeb906e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:20.864898 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2c9d4042-4c4e-4a19-875f-3d208eeb906e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:21.182794 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2c9d4042-4c4e-4a19-875f-3d208eeb906e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:21.201403 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2c9d4042-4c4e-4a19-875f-3d208eeb906e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:21.202889 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2c9d4042-4c4e-4a19-875f-3d208eeb906e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:21.204090 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2c9d4042-4c4e-4a19-875f-3d208eeb906e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1725 microversion: 2.20 time: 0.357052 Jun 28 03:20:21.219038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-52c473b6-1ca4-40f0-9f84-7526fa2b6cac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:21.226674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 174/344] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:20 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1725 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:21.243336 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d16f9fc2-3bee-4da5-baf8-bc748d34a877 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:21.244582 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d16f9fc2-3bee-4da5-baf8-bc748d34a877 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:21.244859 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-52c473b6-1ca4-40f0-9f84-7526fa2b6cac tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1365 microversion: 2.1 time: 0.438286 Jun 28 03:20:21.256371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 171/345] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:20 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1365 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:21.258731 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d16f9fc2-3bee-4da5-baf8-bc748d34a877 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:21.260945 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d16f9fc2-3bee-4da5-baf8-bc748d34a877 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:21.262709 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d16f9fc2-3bee-4da5-baf8-bc748d34a877 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:21.263882 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d16f9fc2-3bee-4da5-baf8-bc748d34a877 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:21.265761 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-a0c52f05-201c-40ba-a809-1fa0f703052c req-521482d4-1e2b-4dc1-bdaa-621847a85593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b33cdf-def8-4dff-a771-d3e795fa0c27", "name": "network-vif-plugged", "status": "completed", "tag": "d436dd45-4104-4290-a33b-f2fe67047429"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:21.299036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a0c52f05-201c-40ba-a809-1fa0f703052c req-521482d4-1e2b-4dc1-bdaa-621847a85593 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:21.299502 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a0c52f05-201c-40ba-a809-1fa0f703052c req-521482d4-1e2b-4dc1-bdaa-621847a85593 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:21.313857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-a0c52f05-201c-40ba-a809-1fa0f703052c req-521482d4-1e2b-4dc1-bdaa-621847a85593 service nova] Creating event network-vif-plugged:d436dd45-4104-4290-a33b-f2fe67047429 for instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 on hv-cinder-84684 Jun 28 03:20:21.319319 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-a0c52f05-201c-40ba-a809-1fa0f703052c req-521482d4-1e2b-4dc1-bdaa-621847a85593 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061581 Jun 28 03:20:21.320027 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 172/346] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:20:21.326882 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-43b3b333-f667-4ec3-9984-b7721880b53c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de1ae3d9-9248-4955-89cf-ce98e1943c09"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:21.328747 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-43b3b333-f667-4ec3-9984-b7721880b53c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:21.335509 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-43b3b333-f667-4ec3-9984-b7721880b53c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:21.335963 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-43b3b333-f667-4ec3-9984-b7721880b53c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:21.336761 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-43b3b333-f667-4ec3-9984-b7721880b53c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:21.337191 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-43b3b333-f667-4ec3-9984-b7721880b53c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:21.564928 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d16f9fc2-3bee-4da5-baf8-bc748d34a877 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:21.583904 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d16f9fc2-3bee-4da5-baf8-bc748d34a877 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.354850 Jun 28 03:20:21.592483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 175/347] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:21 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:21.641861 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1615226984", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-378644166", "security_groups": [{"name": "tempest-secgroup-smoke-1196702488"}], "networks": [{"uuid": "637d8db0-e115-438e-98d4-4018ed69f48c"}], "block_device_mapping_v2": [{"uuid": "3d36ee30-d3d9-4412-af72-28fe6a167d5e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:21.984098 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.network.neutron [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] validate_networks() for [('637d8db0-e115-438e-98d4-4018ed69f48c', None, None, None, None, None)] {{(pid=117681) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:20:22.061702 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-43b3b333-f667-4ec3-9984-b7721880b53c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "POST /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.739843 Jun 28 03:20:22.063079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 173/348] 10.222.0.44 () {62 vars in 1363 bytes} [Tue Jun 28 03:20:21 2022] POST /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-volume_attachments => generated 188 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:20:22.211574 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-88b267e2-99c5-4e0f-a1e2-c811e2ec543f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:22.213036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-88b267e2-99c5-4e0f-a1e2-c811e2ec543f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:22.220032 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-88b267e2-99c5-4e0f-a1e2-c811e2ec543f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:22.220490 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-88b267e2-99c5-4e0f-a1e2-c811e2ec543f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:22.221253 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-88b267e2-99c5-4e0f-a1e2-c811e2ec543f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:22.221677 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-88b267e2-99c5-4e0f-a1e2-c811e2ec543f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:22.378218 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-88b267e2-99c5-4e0f-a1e2-c811e2ec543f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "POST /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/action" status: 202 len: 0 microversion: 2.20 time: 0.174420 Jun 28 03:20:22.381122 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 174/349] 10.222.0.44 () {62 vars in 1318 bytes} [Tue Jun 28 03:20:22 2022] POST /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:20:22.386736 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8cfae0f2-a4df-4966-a25d-6397ee6f0ff4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:22.395238 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8cfae0f2-a4df-4966-a25d-6397ee6f0ff4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:22.404696 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8cfae0f2-a4df-4966-a25d-6397ee6f0ff4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:22.407151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8cfae0f2-a4df-4966-a25d-6397ee6f0ff4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:22.410812 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8cfae0f2-a4df-4966-a25d-6397ee6f0ff4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:22.412362 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8cfae0f2-a4df-4966-a25d-6397ee6f0ff4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:22.485201 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Flavor limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:20:22.485842 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Image limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:20:22.486733 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Flavor pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:20:22.487361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Image pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:20:22.487922 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:20:22.502483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:22.507367 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:22.510859 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:22.511983 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:22.563363 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Getting quotas for project bcfe66d2ca71404e9b032806db987d4d. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:20:22.578955 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Getting quotas for user c20be92bb6664d518ad0550c43b5e378 and project bcfe66d2ca71404e9b032806db987d4d. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:20:22.725248 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Going to run 1 instances... {{(pid=117681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:20:22.727947 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d36ee30-d3d9-4412-af72-28fe6a167d5e',volume_size=None,volume_type=None)] {{(pid=117681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:20:22.747520 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8cfae0f2-a4df-4966-a25d-6397ee6f0ff4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:22.768302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8cfae0f2-a4df-4966-a25d-6397ee6f0ff4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1365 microversion: 2.1 time: 0.385950 Jun 28 03:20:22.769458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 175/350] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:22 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1365 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:22.777459 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7a1d57ae-2be4-4d7a-8932-1b5ff813fdf9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:22.778312 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7a1d57ae-2be4-4d7a-8932-1b5ff813fdf9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:22.785219 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7a1d57ae-2be4-4d7a-8932-1b5ff813fdf9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:22.785784 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7a1d57ae-2be4-4d7a-8932-1b5ff813fdf9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:22.786848 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7a1d57ae-2be4-4d7a-8932-1b5ff813fdf9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:22.787403 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7a1d57ae-2be4-4d7a-8932-1b5ff813fdf9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:22.988009 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-74a2aa2e-c103-4a9c-a414-96a1e4c0a136 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.347435 Jun 28 03:20:22.989399 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 176/351] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:20:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:20:22.999112 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3b4beb7b-76d6-45a7-a673-d353e77a27b2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:22.999894 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-3b4beb7b-76d6-45a7-a673-d353e77a27b2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:23.008801 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3b4beb7b-76d6-45a7-a673-d353e77a27b2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:23.009503 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3b4beb7b-76d6-45a7-a673-d353e77a27b2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:23.010624 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3b4beb7b-76d6-45a7-a673-d353e77a27b2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:23.012513 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3b4beb7b-76d6-45a7-a673-d353e77a27b2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:23.044754 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7a1d57ae-2be4-4d7a-8932-1b5ff813fdf9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:23.061802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7a1d57ae-2be4-4d7a-8932-1b5ff813fdf9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:23.064949 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7a1d57ae-2be4-4d7a-8932-1b5ff813fdf9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:23.066663 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7a1d57ae-2be4-4d7a-8932-1b5ff813fdf9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1751 microversion: 2.20 time: 0.295871 Jun 28 03:20:23.067440 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 176/352] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:22 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1751 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:23.092804 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-aaa1fd6a-f665-4f46-90a9-5b17aed79494 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:23.093507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-aaa1fd6a-f665-4f46-90a9-5b17aed79494 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:23.177359 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-aaa1fd6a-f665-4f46-90a9-5b17aed79494 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:23.189679 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-aaa1fd6a-f665-4f46-90a9-5b17aed79494 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1088 microversion: 2.1 time: 0.117476 Jun 28 03:20:23.193660 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 177/353] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:23 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1088 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:23.263855 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-3b4beb7b-76d6-45a7-a673-d353e77a27b2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:23.273041 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3b4beb7b-76d6-45a7-a673-d353e77a27b2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.281975 Jun 28 03:20:23.274065 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 177/354] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:22 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:23.350484 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-165fd58c-87dc-4b9c-a98f-9092369d8356 req-6832a869-6f7d-41c5-ad84-c21dcfd6c461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f3fd86-9d6c-4d2e-8997-579c77adc3f0", "name": "network-vif-unplugged", "status": "completed", "tag": "9e28a86b-c03c-4271-880f-a8d72e9df423"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:23.374385 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-165fd58c-87dc-4b9c-a98f-9092369d8356 req-6832a869-6f7d-41c5-ad84-c21dcfd6c461 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:23.374913 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-165fd58c-87dc-4b9c-a98f-9092369d8356 req-6832a869-6f7d-41c5-ad84-c21dcfd6c461 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:23.414539 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.compute.server_external_events [req-165fd58c-87dc-4b9c-a98f-9092369d8356 req-6832a869-6f7d-41c5-ad84-c21dcfd6c461 service nova] Unable to find a host for instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0. Dropping event network-vif-unplugged {{(pid=117680) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 28 03:20:23.415690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-165fd58c-87dc-4b9c-a98f-9092369d8356 req-6832a869-6f7d-41c5-ad84-c21dcfd6c461 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.070062 Jun 28 03:20:23.416712 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 178/355] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 72 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 28 03:20:23.786149 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e854cf70-11a5-41f5-b3b5-c35c91d4a133 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:23.787178 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e854cf70-11a5-41f5-b3b5-c35c91d4a133 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:23.795711 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e854cf70-11a5-41f5-b3b5-c35c91d4a133 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:23.807845 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e854cf70-11a5-41f5-b3b5-c35c91d4a133 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:23.815306 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e854cf70-11a5-41f5-b3b5-c35c91d4a133 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:23.815797 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e854cf70-11a5-41f5-b3b5-c35c91d4a133 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:24.037217 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e854cf70-11a5-41f5-b3b5-c35c91d4a133 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:24.047170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e854cf70-11a5-41f5-b3b5-c35c91d4a133 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1554 microversion: 2.1 time: 0.265066 Jun 28 03:20:24.047876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 178/356] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:23 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1554 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:24.065260 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-611a7caa-8a7a-4d8c-93f9-b842c6d6a62c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:24.066427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-611a7caa-8a7a-4d8c-93f9-b842c6d6a62c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:24.072661 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-611a7caa-8a7a-4d8c-93f9-b842c6d6a62c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:24.073479 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-611a7caa-8a7a-4d8c-93f9-b842c6d6a62c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:24.074401 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-611a7caa-8a7a-4d8c-93f9-b842c6d6a62c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:24.074995 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-611a7caa-8a7a-4d8c-93f9-b842c6d6a62c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:24.091722 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-272d9496-f0da-4394-80b0-2f7968c01016 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:24.092672 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-272d9496-f0da-4394-80b0-2f7968c01016 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:24.111029 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-272d9496-f0da-4394-80b0-2f7968c01016 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:24.112759 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-272d9496-f0da-4394-80b0-2f7968c01016 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:24.114924 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-272d9496-f0da-4394-80b0-2f7968c01016 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:24.115945 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-272d9496-f0da-4394-80b0-2f7968c01016 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:24.193799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-611a7caa-8a7a-4d8c-93f9-b842c6d6a62c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132362 Jun 28 03:20:24.200841 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 179/357] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 28 03:20:24 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:20:24.208661 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e20d13bb-ed59-471c-815a-2d5bd8bc9281 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:24.209239 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e20d13bb-ed59-471c-815a-2d5bd8bc9281 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:24.219203 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e20d13bb-ed59-471c-815a-2d5bd8bc9281 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:24.219642 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e20d13bb-ed59-471c-815a-2d5bd8bc9281 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:24.220440 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e20d13bb-ed59-471c-815a-2d5bd8bc9281 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:24.220866 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e20d13bb-ed59-471c-815a-2d5bd8bc9281 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:24.386260 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e20d13bb-ed59-471c-815a-2d5bd8bc9281 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:24.397048 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e20d13bb-ed59-471c-815a-2d5bd8bc9281 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1138 microversion: 2.1 time: 0.193695 Jun 28 03:20:24.397629 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 180/358] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:24 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1138 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:20:24.406169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e07e75f3-7c7a-4c03-b8e0-a2acd5ad7209 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:24.406804 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e07e75f3-7c7a-4c03-b8e0-a2acd5ad7209 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:24.419489 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e07e75f3-7c7a-4c03-b8e0-a2acd5ad7209 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:24.420362 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e07e75f3-7c7a-4c03-b8e0-a2acd5ad7209 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:24.422560 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e07e75f3-7c7a-4c03-b8e0-a2acd5ad7209 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:24.424269 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e07e75f3-7c7a-4c03-b8e0-a2acd5ad7209 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:24.443412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-272d9496-f0da-4394-80b0-2f7968c01016 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:24.456474 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-272d9496-f0da-4394-80b0-2f7968c01016 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:24.459013 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-272d9496-f0da-4394-80b0-2f7968c01016 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:24.460248 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-272d9496-f0da-4394-80b0-2f7968c01016 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1751 microversion: 2.20 time: 0.374549 Jun 28 03:20:24.466352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 179/359] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:24 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1751 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:20:24.639091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e07e75f3-7c7a-4c03-b8e0-a2acd5ad7209 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:24.652420 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e07e75f3-7c7a-4c03-b8e0-a2acd5ad7209 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.251097 Jun 28 03:20:24.662351 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 181/360] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:24 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:25.428363 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-07ffb810-69fb-4929-b536-7b35db6f837d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:25.429228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-07ffb810-69fb-4929-b536-7b35db6f837d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:25.431356 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:25.451221 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-07ffb810-69fb-4929-b536-7b35db6f837d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:25.455256 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-07ffb810-69fb-4929-b536-7b35db6f837d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:25.456401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-07ffb810-69fb-4929-b536-7b35db6f837d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:25.457069 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-07ffb810-69fb-4929-b536-7b35db6f837d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:25.484679 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-18057da5-cdf8-4124-8fc9-81ae9e2fe1cd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:25.486752 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-18057da5-cdf8-4124-8fc9-81ae9e2fe1cd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:25.499831 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-18057da5-cdf8-4124-8fc9-81ae9e2fe1cd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:25.506109 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-18057da5-cdf8-4124-8fc9-81ae9e2fe1cd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:25.511958 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-18057da5-cdf8-4124-8fc9-81ae9e2fe1cd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:25.518390 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-18057da5-cdf8-4124-8fc9-81ae9e2fe1cd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:25.639236 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-07ffb810-69fb-4929-b536-7b35db6f837d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:25.647378 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-07ffb810-69fb-4929-b536-7b35db6f837d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1138 microversion: 2.1 time: 0.237246 Jun 28 03:20:25.651718 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 180/361] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:25 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1138 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:25.670161 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4133ce24-554e-4b6f-a896-5b9c1665c1fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:25.671155 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4133ce24-554e-4b6f-a896-5b9c1665c1fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:25.682999 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4133ce24-554e-4b6f-a896-5b9c1665c1fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:25.683856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4133ce24-554e-4b6f-a896-5b9c1665c1fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:25.689367 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4133ce24-554e-4b6f-a896-5b9c1665c1fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:25.690235 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4133ce24-554e-4b6f-a896-5b9c1665c1fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:25.833788 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-18057da5-cdf8-4124-8fc9-81ae9e2fe1cd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:25.841821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:25.853309 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-18057da5-cdf8-4124-8fc9-81ae9e2fe1cd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:25.856022 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-18057da5-cdf8-4124-8fc9-81ae9e2fe1cd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:25.857743 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-18057da5-cdf8-4124-8fc9-81ae9e2fe1cd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1751 microversion: 2.20 time: 0.379452 Jun 28 03:20:25.871401 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 182/362] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:25 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1751 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:25.923174 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4133ce24-554e-4b6f-a896-5b9c1665c1fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:25.931626 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4133ce24-554e-4b6f-a896-5b9c1665c1fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.265404 Jun 28 03:20:25.932690 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 181/363] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:25 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:20:26.110293 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-fd2d66f6-7323-470d-b0f6-22525cf1e6af req-f59c8005-ffa8-468b-9908-7298d59e0c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72b33cdf-def8-4dff-a771-d3e795fa0c27", "tag": "d436dd45-4104-4290-a33b-f2fe67047429"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:26.120856 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-fd2d66f6-7323-470d-b0f6-22525cf1e6af req-f59c8005-ffa8-468b-9908-7298d59e0c0d service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:26.121645 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-fd2d66f6-7323-470d-b0f6-22525cf1e6af req-f59c8005-ffa8-468b-9908-7298d59e0c0d service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:26.135482 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-fd2d66f6-7323-470d-b0f6-22525cf1e6af req-f59c8005-ffa8-468b-9908-7298d59e0c0d service nova] Creating event network-changed:d436dd45-4104-4290-a33b-f2fe67047429 for instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 on hv-cinder-84684 Jun 28 03:20:26.152011 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-fd2d66f6-7323-470d-b0f6-22525cf1e6af req-f59c8005-ffa8-468b-9908-7298d59e0c0d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050470 Jun 28 03:20:26.156861 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 183/364] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:20:26.670445 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c679ae8a-2053-412e-9944-9f14db74a8b8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:26.671928 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c679ae8a-2053-412e-9944-9f14db74a8b8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:26.700193 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c679ae8a-2053-412e-9944-9f14db74a8b8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:26.700907 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c679ae8a-2053-412e-9944-9f14db74a8b8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:26.701918 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c679ae8a-2053-412e-9944-9f14db74a8b8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:26.702667 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c679ae8a-2053-412e-9944-9f14db74a8b8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:26.882396 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f402e7c5-c2e9-41e7-a78f-2cbda1eef93d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:26.886958 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f402e7c5-c2e9-41e7-a78f-2cbda1eef93d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:26.904976 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f402e7c5-c2e9-41e7-a78f-2cbda1eef93d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:26.908801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f402e7c5-c2e9-41e7-a78f-2cbda1eef93d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:26.910608 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f402e7c5-c2e9-41e7-a78f-2cbda1eef93d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:26.911298 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f402e7c5-c2e9-41e7-a78f-2cbda1eef93d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:26.931553 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c679ae8a-2053-412e-9944-9f14db74a8b8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:26.945569 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c679ae8a-2053-412e-9944-9f14db74a8b8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1130 microversion: 2.1 time: 0.281814 Jun 28 03:20:26.948716 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 182/365] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:26 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1130 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:26.960349 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-0c0608ba-8c4e-47bd-a5b3-bbd62482960d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:26.961296 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-0c0608ba-8c4e-47bd-a5b3-bbd62482960d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:26.968663 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0c0608ba-8c4e-47bd-a5b3-bbd62482960d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:26.969379 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0c0608ba-8c4e-47bd-a5b3-bbd62482960d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:26.970336 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0c0608ba-8c4e-47bd-a5b3-bbd62482960d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:26.970959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0c0608ba-8c4e-47bd-a5b3-bbd62482960d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:27.284624 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-0c0608ba-8c4e-47bd-a5b3-bbd62482960d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:27.297027 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-0c0608ba-8c4e-47bd-a5b3-bbd62482960d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.346380 Jun 28 03:20:27.297818 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f402e7c5-c2e9-41e7-a78f-2cbda1eef93d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:27.297955 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 183/366] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:26 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:27.314972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f402e7c5-c2e9-41e7-a78f-2cbda1eef93d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:27.316891 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f402e7c5-c2e9-41e7-a78f-2cbda1eef93d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:27.318391 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f402e7c5-c2e9-41e7-a78f-2cbda1eef93d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1753 microversion: 2.20 time: 0.441907 Jun 28 03:20:27.319092 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 184/367] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:26 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1753 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:27.967574 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e3af29f1-01ba-4c64-af18-288a0c735493 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:27.970364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e3af29f1-01ba-4c64-af18-288a0c735493 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:27.995563 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e3af29f1-01ba-4c64-af18-288a0c735493 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:28.000882 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e3af29f1-01ba-4c64-af18-288a0c735493 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:28.003865 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e3af29f1-01ba-4c64-af18-288a0c735493 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:28.005489 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e3af29f1-01ba-4c64-af18-288a0c735493 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:28.140552 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e3af29f1-01ba-4c64-af18-288a0c735493 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:28.143189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=100 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:28.154044 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e3af29f1-01ba-4c64-af18-288a0c735493 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1204 microversion: 2.1 time: 0.191768 Jun 28 03:20:28.154836 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 184/368] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:27 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1204 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:28.315442 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-baad1710-a1c7-4912-83f2-731bb44158f4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:28.315863 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-baad1710-a1c7-4912-83f2-731bb44158f4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:28.330382 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-baad1710-a1c7-4912-83f2-731bb44158f4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:28.330925 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-baad1710-a1c7-4912-83f2-731bb44158f4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:28.331917 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-baad1710-a1c7-4912-83f2-731bb44158f4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:28.335409 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-baad1710-a1c7-4912-83f2-731bb44158f4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:28.343077 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-5162b6c6-05f1-47cc-85ce-ca20eabb8730 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:28.343077 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-5162b6c6-05f1-47cc-85ce-ca20eabb8730 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:28.353431 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5162b6c6-05f1-47cc-85ce-ca20eabb8730 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:28.366436 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5162b6c6-05f1-47cc-85ce-ca20eabb8730 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:28.367400 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5162b6c6-05f1-47cc-85ce-ca20eabb8730 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:28.368601 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5162b6c6-05f1-47cc-85ce-ca20eabb8730 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:28.641066 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-baad1710-a1c7-4912-83f2-731bb44158f4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:28.655308 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-baad1710-a1c7-4912-83f2-731bb44158f4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.344857 Jun 28 03:20:28.670768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 185/369] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:28 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:28.686361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-5162b6c6-05f1-47cc-85ce-ca20eabb8730 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:28.701697 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-5162b6c6-05f1-47cc-85ce-ca20eabb8730 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:28.703539 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-5162b6c6-05f1-47cc-85ce-ca20eabb8730 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:28.705945 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-5162b6c6-05f1-47cc-85ce-ca20eabb8730 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1753 microversion: 2.20 time: 0.368501 Jun 28 03:20:28.707381 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 185/370] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:28 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1753 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:29.184049 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cd409dd7-13ef-4208-a93d-606f4bb06e0c tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:29.185841 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cd409dd7-13ef-4208-a93d-606f4bb06e0c tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:29.230489 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd409dd7-13ef-4208-a93d-606f4bb06e0c tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:29.230941 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd409dd7-13ef-4208-a93d-606f4bb06e0c tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:29.242781 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd409dd7-13ef-4208-a93d-606f4bb06e0c tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:29.243562 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd409dd7-13ef-4208-a93d-606f4bb06e0c tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:29.541890 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cd409dd7-13ef-4208-a93d-606f4bb06e0c tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:29.550788 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cd409dd7-13ef-4208-a93d-606f4bb06e0c tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1272 microversion: 2.1 time: 0.373375 Jun 28 03:20:29.557076 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 186/371] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:29 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1272 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:29.675139 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b1d86a5a-3d60-4606-8156-a556894923ac tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:29.676124 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b1d86a5a-3d60-4606-8156-a556894923ac tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:29.692207 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b1d86a5a-3d60-4606-8156-a556894923ac tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:29.692703 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b1d86a5a-3d60-4606-8156-a556894923ac tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:29.693754 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b1d86a5a-3d60-4606-8156-a556894923ac tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:29.694465 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b1d86a5a-3d60-4606-8156-a556894923ac tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:29.726106 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6cf84cc5-8a1b-4980-bf91-03244d099d12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:29.727592 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6cf84cc5-8a1b-4980-bf91-03244d099d12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:29.742414 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6cf84cc5-8a1b-4980-bf91-03244d099d12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:29.743275 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6cf84cc5-8a1b-4980-bf91-03244d099d12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:29.744306 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6cf84cc5-8a1b-4980-bf91-03244d099d12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:29.745197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6cf84cc5-8a1b-4980-bf91-03244d099d12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:30.041832 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b1d86a5a-3d60-4606-8156-a556894923ac tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:30.066472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b1d86a5a-3d60-4606-8156-a556894923ac tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.392571 Jun 28 03:20:30.067960 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 186/372] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:29 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:30.092051 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6cf84cc5-8a1b-4980-bf91-03244d099d12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:30.111079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6cf84cc5-8a1b-4980-bf91-03244d099d12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:30.117042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6cf84cc5-8a1b-4980-bf91-03244d099d12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:30.118890 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6cf84cc5-8a1b-4980-bf91-03244d099d12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.396924 Jun 28 03:20:30.123260 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 187/373] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:29 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:20:30.141724 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-c2a6a715-9249-4bba-832a-49c6338c397f req-60a61f18-eda4-47e2-aa7e-69420093e50b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d20165-bd26-4933-9494-f57e12a4af62", "tag": "5ef0c0c3-3a01-4e07-9e58-af12fe750d01"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:30.160795 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-c2a6a715-9249-4bba-832a-49c6338c397f req-60a61f18-eda4-47e2-aa7e-69420093e50b service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:30.162781 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-c2a6a715-9249-4bba-832a-49c6338c397f req-60a61f18-eda4-47e2-aa7e-69420093e50b service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:30.197271 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-c2a6a715-9249-4bba-832a-49c6338c397f req-60a61f18-eda4-47e2-aa7e-69420093e50b service nova] Creating event network-changed:5ef0c0c3-3a01-4e07-9e58-af12fe750d01 for instance 18d20165-bd26-4933-9494-f57e12a4af62 on hv-cinder-84684 Jun 28 03:20:30.214974 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-c2a6a715-9249-4bba-832a-49c6338c397f req-60a61f18-eda4-47e2-aa7e-69420093e50b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077380 Jun 28 03:20:30.216512 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 187/374] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:20:30.574399 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8c022bc7-50b9-4497-ac82-c25656ec2f33 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:30.575658 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8c022bc7-50b9-4497-ac82-c25656ec2f33 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:30.592779 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8c022bc7-50b9-4497-ac82-c25656ec2f33 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:30.594548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8c022bc7-50b9-4497-ac82-c25656ec2f33 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:30.595543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8c022bc7-50b9-4497-ac82-c25656ec2f33 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:30.599272 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8c022bc7-50b9-4497-ac82-c25656ec2f33 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:30.880397 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8c022bc7-50b9-4497-ac82-c25656ec2f33 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:30.891427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8c022bc7-50b9-4497-ac82-c25656ec2f33 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.321529 Jun 28 03:20:30.892027 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 188/375] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:30 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:31.085871 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-bc1572a1-2cd3-4410-99f9-5ba9715f2556 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:31.087150 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-bc1572a1-2cd3-4410-99f9-5ba9715f2556 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:31.104654 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bc1572a1-2cd3-4410-99f9-5ba9715f2556 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:31.105558 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bc1572a1-2cd3-4410-99f9-5ba9715f2556 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:31.107431 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bc1572a1-2cd3-4410-99f9-5ba9715f2556 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:31.108544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bc1572a1-2cd3-4410-99f9-5ba9715f2556 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:31.143167 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cd073ef9-f3e3-44f4-971b-0e0703578a9f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:31.143865 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cd073ef9-f3e3-44f4-971b-0e0703578a9f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:31.155572 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd073ef9-f3e3-44f4-971b-0e0703578a9f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:31.156096 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd073ef9-f3e3-44f4-971b-0e0703578a9f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:31.157139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd073ef9-f3e3-44f4-971b-0e0703578a9f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:31.157848 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd073ef9-f3e3-44f4-971b-0e0703578a9f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:31.454024 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-bc1572a1-2cd3-4410-99f9-5ba9715f2556 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:31.458828 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cd073ef9-f3e3-44f4-971b-0e0703578a9f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:31.465847 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-bc1572a1-2cd3-4410-99f9-5ba9715f2556 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.384256 Jun 28 03:20:31.467167 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 188/376] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:31 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:31.471977 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cd073ef9-f3e3-44f4-971b-0e0703578a9f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:31.473629 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cd073ef9-f3e3-44f4-971b-0e0703578a9f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:31.474875 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cd073ef9-f3e3-44f4-971b-0e0703578a9f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.336122 Jun 28 03:20:31.480403 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 189/377] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:31 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:20:31.910991 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f8fef5f4-138b-4ce0-bbb1-4d8b5045191a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:31.914469 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f8fef5f4-138b-4ce0-bbb1-4d8b5045191a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:31.950961 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f8fef5f4-138b-4ce0-bbb1-4d8b5045191a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:31.953458 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f8fef5f4-138b-4ce0-bbb1-4d8b5045191a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:31.954512 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f8fef5f4-138b-4ce0-bbb1-4d8b5045191a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:31.955157 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f8fef5f4-138b-4ce0-bbb1-4d8b5045191a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:32.301817 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-f8fef5f4-138b-4ce0-bbb1-4d8b5045191a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:32.312821 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f8fef5f4-138b-4ce0-bbb1-4d8b5045191a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.406300 Jun 28 03:20:32.313420 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 189/378] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:31 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:32.483754 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-71c978d1-aa98-4c76-a7b9-6772d212236b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:32.484432 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-71c978d1-aa98-4c76-a7b9-6772d212236b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:32.494066 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-71c978d1-aa98-4c76-a7b9-6772d212236b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:32.494625 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-71c978d1-aa98-4c76-a7b9-6772d212236b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:32.495637 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-71c978d1-aa98-4c76-a7b9-6772d212236b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:32.495846 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-71c978d1-aa98-4c76-a7b9-6772d212236b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:32.497287 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a192fe7f-fbff-4e5e-9eec-47d8508c4bf1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:32.498516 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a192fe7f-fbff-4e5e-9eec-47d8508c4bf1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:32.509450 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a192fe7f-fbff-4e5e-9eec-47d8508c4bf1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:32.511311 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a192fe7f-fbff-4e5e-9eec-47d8508c4bf1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:32.512625 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a192fe7f-fbff-4e5e-9eec-47d8508c4bf1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:32.513296 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a192fe7f-fbff-4e5e-9eec-47d8508c4bf1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:32.538291 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:32.604959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=6 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:32.814970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a192fe7f-fbff-4e5e-9eec-47d8508c4bf1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:32.831143 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a192fe7f-fbff-4e5e-9eec-47d8508c4bf1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:32.832511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-71c978d1-aa98-4c76-a7b9-6772d212236b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:32.833573 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a192fe7f-fbff-4e5e-9eec-47d8508c4bf1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:32.835081 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a192fe7f-fbff-4e5e-9eec-47d8508c4bf1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.344693 Jun 28 03:20:32.836200 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 190/379] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:32 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:32.843061 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-71c978d1-aa98-4c76-a7b9-6772d212236b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.363857 Jun 28 03:20:32.847333 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 190/380] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:32 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:33.331829 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b9ed3ea5-85d0-47a8-9bad-43af7b5db997 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:33.333239 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b9ed3ea5-85d0-47a8-9bad-43af7b5db997 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:33.341823 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b9ed3ea5-85d0-47a8-9bad-43af7b5db997 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:33.342454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b9ed3ea5-85d0-47a8-9bad-43af7b5db997 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:33.343316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b9ed3ea5-85d0-47a8-9bad-43af7b5db997 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:33.343971 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b9ed3ea5-85d0-47a8-9bad-43af7b5db997 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:33.512249 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b9ed3ea5-85d0-47a8-9bad-43af7b5db997 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:33.520846 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b9ed3ea5-85d0-47a8-9bad-43af7b5db997 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.192789 Jun 28 03:20:33.521456 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 191/381] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:33 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:33.855285 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7af9d430-2d2a-4a9b-acaa-0c78c8417c69 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:33.856537 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7af9d430-2d2a-4a9b-acaa-0c78c8417c69 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:33.858887 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:33.860633 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-0b62ad46-7e73-4fa8-86aa-a37c0e259b4e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:33.861225 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-0b62ad46-7e73-4fa8-86aa-a37c0e259b4e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:33.865042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7af9d430-2d2a-4a9b-acaa-0c78c8417c69 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:33.865489 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7af9d430-2d2a-4a9b-acaa-0c78c8417c69 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:33.866262 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7af9d430-2d2a-4a9b-acaa-0c78c8417c69 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:33.866687 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7af9d430-2d2a-4a9b-acaa-0c78c8417c69 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:33.868198 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0b62ad46-7e73-4fa8-86aa-a37c0e259b4e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:33.872232 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0b62ad46-7e73-4fa8-86aa-a37c0e259b4e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:33.872232 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0b62ad46-7e73-4fa8-86aa-a37c0e259b4e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:33.872232 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0b62ad46-7e73-4fa8-86aa-a37c0e259b4e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:34.064793 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-0b62ad46-7e73-4fa8-86aa-a37c0e259b4e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:34.072406 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-0b62ad46-7e73-4fa8-86aa-a37c0e259b4e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.215879 Jun 28 03:20:34.073359 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 192/382] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:33 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:34.087303 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7af9d430-2d2a-4a9b-acaa-0c78c8417c69 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:34.096475 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7af9d430-2d2a-4a9b-acaa-0c78c8417c69 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:34.097960 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7af9d430-2d2a-4a9b-acaa-0c78c8417c69 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:34.099122 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7af9d430-2d2a-4a9b-acaa-0c78c8417c69 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.248641 Jun 28 03:20:34.099722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 191/383] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:33 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:34.538133 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4f1a1047-aadd-4ae7-8a6c-b266e774d170 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:34.538715 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4f1a1047-aadd-4ae7-8a6c-b266e774d170 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:34.545719 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4f1a1047-aadd-4ae7-8a6c-b266e774d170 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:34.546165 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4f1a1047-aadd-4ae7-8a6c-b266e774d170 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:34.546915 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4f1a1047-aadd-4ae7-8a6c-b266e774d170 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:34.547343 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4f1a1047-aadd-4ae7-8a6c-b266e774d170 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:34.691512 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4f1a1047-aadd-4ae7-8a6c-b266e774d170 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:34.700038 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4f1a1047-aadd-4ae7-8a6c-b266e774d170 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.165879 Jun 28 03:20:34.700651 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 193/384] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:34 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:35.092261 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dcacb6de-1a73-4bb6-95af-669d22d19f7c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:35.093049 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dcacb6de-1a73-4bb6-95af-669d22d19f7c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:35.100418 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dcacb6de-1a73-4bb6-95af-669d22d19f7c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:35.100869 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dcacb6de-1a73-4bb6-95af-669d22d19f7c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:35.101928 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dcacb6de-1a73-4bb6-95af-669d22d19f7c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:35.103267 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dcacb6de-1a73-4bb6-95af-669d22d19f7c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:35.119012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-41b3768e-566b-4894-ab44-4f76a6b9004c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:35.119770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-41b3768e-566b-4894-ab44-4f76a6b9004c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:35.130775 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-41b3768e-566b-4894-ab44-4f76a6b9004c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:35.132462 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-41b3768e-566b-4894-ab44-4f76a6b9004c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:35.133418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-41b3768e-566b-4894-ab44-4f76a6b9004c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:35.135307 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-41b3768e-566b-4894-ab44-4f76a6b9004c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:35.360205 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dcacb6de-1a73-4bb6-95af-669d22d19f7c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:35.369279 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dcacb6de-1a73-4bb6-95af-669d22d19f7c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.283480 Jun 28 03:20:35.370123 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 192/385] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:35 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:35.373856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-41b3768e-566b-4894-ab44-4f76a6b9004c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:35.387431 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-41b3768e-566b-4894-ab44-4f76a6b9004c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:35.388945 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-41b3768e-566b-4894-ab44-4f76a6b9004c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:35.390454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-41b3768e-566b-4894-ab44-4f76a6b9004c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.275337 Jun 28 03:20:35.391010 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 194/386] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:35 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:35.718418 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0d2068ff-a77a-4632-8bb9-7df1e3fbb8de tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:35.719166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0d2068ff-a77a-4632-8bb9-7df1e3fbb8de tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:35.728345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d2068ff-a77a-4632-8bb9-7df1e3fbb8de tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:35.729269 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d2068ff-a77a-4632-8bb9-7df1e3fbb8de tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:35.730685 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d2068ff-a77a-4632-8bb9-7df1e3fbb8de tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:35.731323 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d2068ff-a77a-4632-8bb9-7df1e3fbb8de tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:35.920127 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0d2068ff-a77a-4632-8bb9-7df1e3fbb8de tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:35.929618 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0d2068ff-a77a-4632-8bb9-7df1e3fbb8de tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.215409 Jun 28 03:20:35.930193 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 193/387] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:35 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:36.387634 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e8a5de90-2ea3-4000-8d4c-c1959979abd9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:36.388255 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e8a5de90-2ea3-4000-8d4c-c1959979abd9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:36.395619 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e8a5de90-2ea3-4000-8d4c-c1959979abd9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:36.396183 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e8a5de90-2ea3-4000-8d4c-c1959979abd9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:36.397026 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e8a5de90-2ea3-4000-8d4c-c1959979abd9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:36.397541 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e8a5de90-2ea3-4000-8d4c-c1959979abd9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:36.409020 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4862524e-fcc9-4738-b182-fb68b1ae0257 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:36.409774 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4862524e-fcc9-4738-b182-fb68b1ae0257 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:36.417940 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4862524e-fcc9-4738-b182-fb68b1ae0257 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:36.418703 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4862524e-fcc9-4738-b182-fb68b1ae0257 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:36.419683 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4862524e-fcc9-4738-b182-fb68b1ae0257 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:36.420449 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4862524e-fcc9-4738-b182-fb68b1ae0257 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:36.632581 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e8a5de90-2ea3-4000-8d4c-c1959979abd9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:36.636167 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4862524e-fcc9-4738-b182-fb68b1ae0257 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:36.649748 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e8a5de90-2ea3-4000-8d4c-c1959979abd9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.266440 Jun 28 03:20:36.654371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4862524e-fcc9-4738-b182-fb68b1ae0257 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:36.654841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 195/388] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:36 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:36.656529 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4862524e-fcc9-4738-b182-fb68b1ae0257 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:36.657738 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4862524e-fcc9-4738-b182-fb68b1ae0257 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.252778 Jun 28 03:20:36.658704 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 194/389] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:36 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:36.948690 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4d0399fb-617b-4b7e-9c79-91962637c4b3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:36.950003 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4d0399fb-617b-4b7e-9c79-91962637c4b3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:36.960639 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4d0399fb-617b-4b7e-9c79-91962637c4b3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:36.962105 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4d0399fb-617b-4b7e-9c79-91962637c4b3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:36.964644 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4d0399fb-617b-4b7e-9c79-91962637c4b3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:36.965381 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4d0399fb-617b-4b7e-9c79-91962637c4b3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:37.192588 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4d0399fb-617b-4b7e-9c79-91962637c4b3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:37.200266 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4d0399fb-617b-4b7e-9c79-91962637c4b3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.257344 Jun 28 03:20:37.200829 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 196/390] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:36 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:37.667634 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-29978cbe-7c97-4592-8119-167e40ace428 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:37.669028 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-29978cbe-7c97-4592-8119-167e40ace428 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:37.678700 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9610cc3c-8779-4376-805a-599d77197ce3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:37.680019 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-9610cc3c-8779-4376-805a-599d77197ce3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:37.687387 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-29978cbe-7c97-4592-8119-167e40ace428 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:37.687845 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-29978cbe-7c97-4592-8119-167e40ace428 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:37.688003 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9610cc3c-8779-4376-805a-599d77197ce3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:37.688670 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-29978cbe-7c97-4592-8119-167e40ace428 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:37.688967 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9610cc3c-8779-4376-805a-599d77197ce3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:37.689091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-29978cbe-7c97-4592-8119-167e40ace428 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:37.690113 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9610cc3c-8779-4376-805a-599d77197ce3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:37.690623 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9610cc3c-8779-4376-805a-599d77197ce3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:37.935548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-29978cbe-7c97-4592-8119-167e40ace428 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:37.943737 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-29978cbe-7c97-4592-8119-167e40ace428 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.280446 Jun 28 03:20:37.944833 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 195/391] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:37 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:37.965930 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9610cc3c-8779-4376-805a-599d77197ce3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:37.975991 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9610cc3c-8779-4376-805a-599d77197ce3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:37.978098 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9610cc3c-8779-4376-805a-599d77197ce3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:37.980304 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-9610cc3c-8779-4376-805a-599d77197ce3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.305843 Jun 28 03:20:37.992021 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 197/392] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:37 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:38.218523 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d2a44139-618d-4701-af77-3200b6b89db3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:38.219266 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d2a44139-618d-4701-af77-3200b6b89db3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:38.225679 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d2a44139-618d-4701-af77-3200b6b89db3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:38.226450 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d2a44139-618d-4701-af77-3200b6b89db3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:38.227422 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d2a44139-618d-4701-af77-3200b6b89db3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:38.228051 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d2a44139-618d-4701-af77-3200b6b89db3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:38.654212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d2a44139-618d-4701-af77-3200b6b89db3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:38.663684 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d2a44139-618d-4701-af77-3200b6b89db3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.449003 Jun 28 03:20:38.668990 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 196/393] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:38 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:38.961634 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b0ed92e6-b253-4c45-9451-6b0690505d13 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:38.964000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b0ed92e6-b253-4c45-9451-6b0690505d13 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:38.977871 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b0ed92e6-b253-4c45-9451-6b0690505d13 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:38.978286 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b0ed92e6-b253-4c45-9451-6b0690505d13 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:38.979290 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b0ed92e6-b253-4c45-9451-6b0690505d13 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:38.979871 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b0ed92e6-b253-4c45-9451-6b0690505d13 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:38.999259 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-50f93b60-3ad2-41ef-9aee-67b60bc075c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:38.999868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-50f93b60-3ad2-41ef-9aee-67b60bc075c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:39.006253 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-50f93b60-3ad2-41ef-9aee-67b60bc075c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:39.006899 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-50f93b60-3ad2-41ef-9aee-67b60bc075c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:39.007847 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-50f93b60-3ad2-41ef-9aee-67b60bc075c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:39.008468 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-50f93b60-3ad2-41ef-9aee-67b60bc075c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:39.205511 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b0ed92e6-b253-4c45-9451-6b0690505d13 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:39.216921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b0ed92e6-b253-4c45-9451-6b0690505d13 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.259586 Jun 28 03:20:39.218200 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 198/394] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:38 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:39.238395 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-50f93b60-3ad2-41ef-9aee-67b60bc075c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:39.251637 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-50f93b60-3ad2-41ef-9aee-67b60bc075c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:39.259286 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-50f93b60-3ad2-41ef-9aee-67b60bc075c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:39.260852 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-50f93b60-3ad2-41ef-9aee-67b60bc075c9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.265810 Jun 28 03:20:39.261435 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 197/395] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:38 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:20:39.681950 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2bf12cd0-d560-41a5-a147-7b522bc5c6dc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:39.682598 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2bf12cd0-d560-41a5-a147-7b522bc5c6dc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:39.695013 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2bf12cd0-d560-41a5-a147-7b522bc5c6dc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:39.695461 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2bf12cd0-d560-41a5-a147-7b522bc5c6dc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:39.696478 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2bf12cd0-d560-41a5-a147-7b522bc5c6dc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:39.696921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2bf12cd0-d560-41a5-a147-7b522bc5c6dc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:39.867039 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2bf12cd0-d560-41a5-a147-7b522bc5c6dc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:39.874782 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2bf12cd0-d560-41a5-a147-7b522bc5c6dc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.196993 Jun 28 03:20:39.875375 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 199/396] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:39 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:40.234608 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2d6e0a4d-11d0-433d-9c1f-e5dcf7ae7619 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:40.235192 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2d6e0a4d-11d0-433d-9c1f-e5dcf7ae7619 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:40.241921 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2d6e0a4d-11d0-433d-9c1f-e5dcf7ae7619 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:40.242368 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2d6e0a4d-11d0-433d-9c1f-e5dcf7ae7619 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:40.243125 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2d6e0a4d-11d0-433d-9c1f-e5dcf7ae7619 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:40.243553 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2d6e0a4d-11d0-433d-9c1f-e5dcf7ae7619 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:40.279315 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-af27338d-fb02-45a4-8e59-e1cbacb7ad10 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:40.280851 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-af27338d-fb02-45a4-8e59-e1cbacb7ad10 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:40.287839 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-af27338d-fb02-45a4-8e59-e1cbacb7ad10 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:40.288314 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-af27338d-fb02-45a4-8e59-e1cbacb7ad10 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:40.289108 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-af27338d-fb02-45a4-8e59-e1cbacb7ad10 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:40.289531 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-af27338d-fb02-45a4-8e59-e1cbacb7ad10 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:40.448877 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2d6e0a4d-11d0-433d-9c1f-e5dcf7ae7619 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:40.458303 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2d6e0a4d-11d0-433d-9c1f-e5dcf7ae7619 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.227846 Jun 28 03:20:40.459303 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 198/397] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:40 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:20:40.479894 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-af27338d-fb02-45a4-8e59-e1cbacb7ad10 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:40.489661 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-af27338d-fb02-45a4-8e59-e1cbacb7ad10 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:40.491693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-af27338d-fb02-45a4-8e59-e1cbacb7ad10 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:40.493194 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-af27338d-fb02-45a4-8e59-e1cbacb7ad10 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.218221 Jun 28 03:20:40.507617 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 200/398] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:40 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:20:40.891283 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1772afe1-84ad-4ff0-9445-a5178fa5e7cc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:40.892175 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1772afe1-84ad-4ff0-9445-a5178fa5e7cc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:40.898733 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1772afe1-84ad-4ff0-9445-a5178fa5e7cc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:40.899175 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1772afe1-84ad-4ff0-9445-a5178fa5e7cc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:40.899936 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1772afe1-84ad-4ff0-9445-a5178fa5e7cc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:40.900400 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1772afe1-84ad-4ff0-9445-a5178fa5e7cc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:41.037322 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1772afe1-84ad-4ff0-9445-a5178fa5e7cc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:41.046234 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1772afe1-84ad-4ff0-9445-a5178fa5e7cc tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.158761 Jun 28 03:20:41.046828 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 199/399] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:40 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:41.479003 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-775ddfd9-c35e-4969-ba2d-32603cf6b08e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:41.480314 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-775ddfd9-c35e-4969-ba2d-32603cf6b08e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:41.491744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-775ddfd9-c35e-4969-ba2d-32603cf6b08e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:41.492549 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-775ddfd9-c35e-4969-ba2d-32603cf6b08e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:41.493795 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-775ddfd9-c35e-4969-ba2d-32603cf6b08e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:41.494511 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-775ddfd9-c35e-4969-ba2d-32603cf6b08e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:41.515004 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2a8229de-85fc-44f3-8d1e-92a10d259c78 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:41.515571 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2a8229de-85fc-44f3-8d1e-92a10d259c78 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:41.521873 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2a8229de-85fc-44f3-8d1e-92a10d259c78 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:41.522320 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2a8229de-85fc-44f3-8d1e-92a10d259c78 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:41.523074 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2a8229de-85fc-44f3-8d1e-92a10d259c78 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:41.523510 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2a8229de-85fc-44f3-8d1e-92a10d259c78 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:41.526121 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:41.697103 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-775ddfd9-c35e-4969-ba2d-32603cf6b08e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:41.701816 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2a8229de-85fc-44f3-8d1e-92a10d259c78 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:41.704830 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-775ddfd9-c35e-4969-ba2d-32603cf6b08e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.232231 Jun 28 03:20:41.705402 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 201/400] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:41 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:41.711083 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2a8229de-85fc-44f3-8d1e-92a10d259c78 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:41.712575 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2a8229de-85fc-44f3-8d1e-92a10d259c78 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:41.713731 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2a8229de-85fc-44f3-8d1e-92a10d259c78 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.202715 Jun 28 03:20:41.714451 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 200/401] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:41 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:42.063326 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ef487df7-2861-4b9c-98db-48f46ee1b043 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:42.063922 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ef487df7-2861-4b9c-98db-48f46ee1b043 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:42.070564 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ef487df7-2861-4b9c-98db-48f46ee1b043 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:42.070996 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ef487df7-2861-4b9c-98db-48f46ee1b043 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:42.071739 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ef487df7-2861-4b9c-98db-48f46ee1b043 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:42.072174 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ef487df7-2861-4b9c-98db-48f46ee1b043 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:42.074983 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=100 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:42.212125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ef487df7-2861-4b9c-98db-48f46ee1b043 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:42.220604 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ef487df7-2861-4b9c-98db-48f46ee1b043 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.161294 Jun 28 03:20:42.221171 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 202/402] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:42 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:42.725203 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7d7233e9-9030-458d-bab3-39a528a42856 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:42.725957 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7d7233e9-9030-458d-bab3-39a528a42856 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:42.733385 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-606d059d-7efc-48d0-afef-ecfd1b7d1706 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:42.733968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-606d059d-7efc-48d0-afef-ecfd1b7d1706 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:42.734110 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7d7233e9-9030-458d-bab3-39a528a42856 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:42.734554 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7d7233e9-9030-458d-bab3-39a528a42856 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:42.735324 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7d7233e9-9030-458d-bab3-39a528a42856 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:42.735765 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7d7233e9-9030-458d-bab3-39a528a42856 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:42.745396 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-606d059d-7efc-48d0-afef-ecfd1b7d1706 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:42.745871 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-606d059d-7efc-48d0-afef-ecfd1b7d1706 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:42.746633 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-606d059d-7efc-48d0-afef-ecfd1b7d1706 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:42.747110 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-606d059d-7efc-48d0-afef-ecfd1b7d1706 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:42.938216 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7d7233e9-9030-458d-bab3-39a528a42856 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:42.942488 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-606d059d-7efc-48d0-afef-ecfd1b7d1706 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:42.949471 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7d7233e9-9030-458d-bab3-39a528a42856 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.230194 Jun 28 03:20:42.950358 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 201/403] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:42 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:42.953451 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-606d059d-7efc-48d0-afef-ecfd1b7d1706 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:42.954944 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-606d059d-7efc-48d0-afef-ecfd1b7d1706 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:42.956182 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-606d059d-7efc-48d0-afef-ecfd1b7d1706 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.227647 Jun 28 03:20:42.956749 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 203/404] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:42 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:43.242309 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-96e56822-0fd5-4319-99a7-a2e90614b05f tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:43.243314 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-96e56822-0fd5-4319-99a7-a2e90614b05f tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:43.251301 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-96e56822-0fd5-4319-99a7-a2e90614b05f tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:43.251746 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-96e56822-0fd5-4319-99a7-a2e90614b05f tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:43.252537 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-96e56822-0fd5-4319-99a7-a2e90614b05f tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:43.252969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-96e56822-0fd5-4319-99a7-a2e90614b05f tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:43.391702 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-96e56822-0fd5-4319-99a7-a2e90614b05f tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:43.399823 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-96e56822-0fd5-4319-99a7-a2e90614b05f tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.163994 Jun 28 03:20:43.400435 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 202/405] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:43 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:43.970011 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-668e9566-8e80-483e-9267-b8b287527ad4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:43.971109 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-668e9566-8e80-483e-9267-b8b287527ad4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:43.978050 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a2cd2dee-077b-4eeb-8ae7-c65ee7a39ca9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:43.978813 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a2cd2dee-077b-4eeb-8ae7-c65ee7a39ca9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:43.979656 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-668e9566-8e80-483e-9267-b8b287527ad4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:43.980286 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-668e9566-8e80-483e-9267-b8b287527ad4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:43.981462 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-668e9566-8e80-483e-9267-b8b287527ad4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:43.982025 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-668e9566-8e80-483e-9267-b8b287527ad4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:43.987891 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2cd2dee-077b-4eeb-8ae7-c65ee7a39ca9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:43.988473 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2cd2dee-077b-4eeb-8ae7-c65ee7a39ca9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:43.989415 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2cd2dee-077b-4eeb-8ae7-c65ee7a39ca9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:43.989941 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2cd2dee-077b-4eeb-8ae7-c65ee7a39ca9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:44.180866 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-668e9566-8e80-483e-9267-b8b287527ad4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:44.183934 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a2cd2dee-077b-4eeb-8ae7-c65ee7a39ca9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:44.188521 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-668e9566-8e80-483e-9267-b8b287527ad4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.223410 Jun 28 03:20:44.189145 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 204/406] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:43 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:44.192750 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a2cd2dee-077b-4eeb-8ae7-c65ee7a39ca9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:44.194228 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a2cd2dee-077b-4eeb-8ae7-c65ee7a39ca9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:44.195378 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a2cd2dee-077b-4eeb-8ae7-c65ee7a39ca9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.222481 Jun 28 03:20:44.195924 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 203/407] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:43 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:44.420832 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-17e8a1db-3982-405b-844d-f939118f14cf tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:44.421825 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-17e8a1db-3982-405b-844d-f939118f14cf tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:44.432313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-17e8a1db-3982-405b-844d-f939118f14cf tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:44.433091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-17e8a1db-3982-405b-844d-f939118f14cf tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:44.434042 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-17e8a1db-3982-405b-844d-f939118f14cf tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:44.434472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-17e8a1db-3982-405b-844d-f939118f14cf tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:44.573994 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-17e8a1db-3982-405b-844d-f939118f14cf tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:44.581731 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-17e8a1db-3982-405b-844d-f939118f14cf tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.167914 Jun 28 03:20:44.582289 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 205/408] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:44 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:45.210098 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fd4afbd3-23d2-466f-bacc-e2bf89a9a70c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:45.210723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fd4afbd3-23d2-466f-bacc-e2bf89a9a70c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:45.216722 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-cdaab929-3f25-4260-b360-60f217a8b455 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:45.217331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-cdaab929-3f25-4260-b360-60f217a8b455 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:45.218113 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd4afbd3-23d2-466f-bacc-e2bf89a9a70c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:45.218561 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd4afbd3-23d2-466f-bacc-e2bf89a9a70c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:45.219325 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd4afbd3-23d2-466f-bacc-e2bf89a9a70c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:45.219753 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd4afbd3-23d2-466f-bacc-e2bf89a9a70c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:45.223927 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-cdaab929-3f25-4260-b360-60f217a8b455 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:45.224432 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-cdaab929-3f25-4260-b360-60f217a8b455 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:45.225191 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-cdaab929-3f25-4260-b360-60f217a8b455 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:45.225624 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-cdaab929-3f25-4260-b360-60f217a8b455 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:45.409827 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fd4afbd3-23d2-466f-bacc-e2bf89a9a70c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:45.413985 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-cdaab929-3f25-4260-b360-60f217a8b455 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:45.417810 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fd4afbd3-23d2-466f-bacc-e2bf89a9a70c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1522 microversion: 2.1 time: 0.213893 Jun 28 03:20:45.418577 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 204/409] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:45 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:45.422710 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-cdaab929-3f25-4260-b360-60f217a8b455 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:45.424192 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-cdaab929-3f25-4260-b360-60f217a8b455 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:45.425362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-cdaab929-3f25-4260-b360-60f217a8b455 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.213751 Jun 28 03:20:45.425939 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 206/410] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:45 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:45.599136 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7801910f-94d6-4599-9ca6-0ad5e3848760 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:45.599736 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7801910f-94d6-4599-9ca6-0ad5e3848760 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:45.606239 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7801910f-94d6-4599-9ca6-0ad5e3848760 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:45.606688 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7801910f-94d6-4599-9ca6-0ad5e3848760 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:45.607456 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7801910f-94d6-4599-9ca6-0ad5e3848760 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:45.608274 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7801910f-94d6-4599-9ca6-0ad5e3848760 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:45.746970 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7801910f-94d6-4599-9ca6-0ad5e3848760 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:45.754852 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7801910f-94d6-4599-9ca6-0ad5e3848760 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.159621 Jun 28 03:20:45.764311 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 205/411] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:45 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:46.435461 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c79bce1d-bb68-4230-8eba-f12f0b7553c5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:46.436071 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c79bce1d-bb68-4230-8eba-f12f0b7553c5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:46.443923 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-be69f4f6-f8a2-4c73-a34c-2ec0ec96eb25 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:46.444551 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-be69f4f6-f8a2-4c73-a34c-2ec0ec96eb25 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:46.453304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be69f4f6-f8a2-4c73-a34c-2ec0ec96eb25 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:46.453685 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c79bce1d-bb68-4230-8eba-f12f0b7553c5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:46.453838 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be69f4f6-f8a2-4c73-a34c-2ec0ec96eb25 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:46.454359 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c79bce1d-bb68-4230-8eba-f12f0b7553c5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:46.454477 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be69f4f6-f8a2-4c73-a34c-2ec0ec96eb25 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:46.454888 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be69f4f6-f8a2-4c73-a34c-2ec0ec96eb25 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:46.455279 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c79bce1d-bb68-4230-8eba-f12f0b7553c5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:46.455877 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c79bce1d-bb68-4230-8eba-f12f0b7553c5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:46.659734 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c79bce1d-bb68-4230-8eba-f12f0b7553c5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:46.666677 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-be69f4f6-f8a2-4c73-a34c-2ec0ec96eb25 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:46.667352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c79bce1d-bb68-4230-8eba-f12f0b7553c5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1502 microversion: 2.1 time: 0.236403 Jun 28 03:20:46.667917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 207/412] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:46 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1502 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:46.675790 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-be69f4f6-f8a2-4c73-a34c-2ec0ec96eb25 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:46.677292 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-be69f4f6-f8a2-4c73-a34c-2ec0ec96eb25 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:46.679707 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-be69f4f6-f8a2-4c73-a34c-2ec0ec96eb25 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.239751 Jun 28 03:20:46.680281 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 206/413] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:46 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:46.683379 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c23e2daa-85ee-4de9-b0ad-9741bb5fd26c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:46.683957 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c23e2daa-85ee-4de9-b0ad-9741bb5fd26c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:46.690462 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c23e2daa-85ee-4de9-b0ad-9741bb5fd26c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:46.690944 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c23e2daa-85ee-4de9-b0ad-9741bb5fd26c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:46.691626 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c23e2daa-85ee-4de9-b0ad-9741bb5fd26c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:46.692019 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c23e2daa-85ee-4de9-b0ad-9741bb5fd26c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:46.770869 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-38406c46-5b55-42e6-8f67-bc6a94607161 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:46.771474 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-38406c46-5b55-42e6-8f67-bc6a94607161 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:46.778434 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-38406c46-5b55-42e6-8f67-bc6a94607161 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:46.778875 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-38406c46-5b55-42e6-8f67-bc6a94607161 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:46.779671 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-38406c46-5b55-42e6-8f67-bc6a94607161 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:46.780124 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-38406c46-5b55-42e6-8f67-bc6a94607161 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:46.835756 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c23e2daa-85ee-4de9-b0ad-9741bb5fd26c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:46.843656 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c23e2daa-85ee-4de9-b0ad-9741bb5fd26c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1516 microversion: 2.1 time: 0.164246 Jun 28 03:20:46.844467 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 208/414] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:46 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:20:46.925709 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-38406c46-5b55-42e6-8f67-bc6a94607161 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:46.933727 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-38406c46-5b55-42e6-8f67-bc6a94607161 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.166781 Jun 28 03:20:46.934510 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 207/415] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:46 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:47.124108 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-94e14f45-fadf-4d96-a0f5-a2fc36cb3e07 req-552eff54-09ed-4bd2-af4d-02662e6ef117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d20165-bd26-4933-9494-f57e12a4af62", "name": "network-vif-plugged", "status": "completed", "tag": "5ef0c0c3-3a01-4e07-9e58-af12fe750d01"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:47.134708 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-94e14f45-fadf-4d96-a0f5-a2fc36cb3e07 req-552eff54-09ed-4bd2-af4d-02662e6ef117 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:47.137050 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-94e14f45-fadf-4d96-a0f5-a2fc36cb3e07 req-552eff54-09ed-4bd2-af4d-02662e6ef117 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:47.149140 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-94e14f45-fadf-4d96-a0f5-a2fc36cb3e07 req-552eff54-09ed-4bd2-af4d-02662e6ef117 service nova] Creating event network-vif-plugged:5ef0c0c3-3a01-4e07-9e58-af12fe750d01 for instance 18d20165-bd26-4933-9494-f57e12a4af62 on hv-cinder-84684 Jun 28 03:20:47.155429 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-94e14f45-fadf-4d96-a0f5-a2fc36cb3e07 req-552eff54-09ed-4bd2-af4d-02662e6ef117 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034973 Jun 28 03:20:47.156612 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 209/416] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:20:47.700011 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c46da4ca-48ab-492b-92d2-a3ce04bc6c84 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:47.700862 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c46da4ca-48ab-492b-92d2-a3ce04bc6c84 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:47.709440 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c46da4ca-48ab-492b-92d2-a3ce04bc6c84 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:47.710040 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c46da4ca-48ab-492b-92d2-a3ce04bc6c84 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:47.711045 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c46da4ca-48ab-492b-92d2-a3ce04bc6c84 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:47.711621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c46da4ca-48ab-492b-92d2-a3ce04bc6c84 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:47.852522 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c46da4ca-48ab-492b-92d2-a3ce04bc6c84 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:47.862106 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c46da4ca-48ab-492b-92d2-a3ce04bc6c84 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:47.863587 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c46da4ca-48ab-492b-92d2-a3ce04bc6c84 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:47.864793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c46da4ca-48ab-492b-92d2-a3ce04bc6c84 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.170158 Jun 28 03:20:47.865354 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 208/417] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:47 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:47.953369 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-1905a3da-c753-41ef-a56b-47bea9a88ae5 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:47.954006 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-1905a3da-c753-41ef-a56b-47bea9a88ae5 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:47.961609 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1905a3da-c753-41ef-a56b-47bea9a88ae5 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:47.962106 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1905a3da-c753-41ef-a56b-47bea9a88ae5 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:47.962938 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1905a3da-c753-41ef-a56b-47bea9a88ae5 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:47.963409 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1905a3da-c753-41ef-a56b-47bea9a88ae5 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:48.100092 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-1905a3da-c753-41ef-a56b-47bea9a88ae5 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:48.108130 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-1905a3da-c753-41ef-a56b-47bea9a88ae5 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1260 microversion: 2.1 time: 0.160570 Jun 28 03:20:48.108727 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 210/418] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:47 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:48.239773 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9cf6d4fd-e5c2-44c0-8ea2-e107e8bbce07 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:48.241475 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9cf6d4fd-e5c2-44c0-8ea2-e107e8bbce07 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:48.248807 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9cf6d4fd-e5c2-44c0-8ea2-e107e8bbce07 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:48.249248 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9cf6d4fd-e5c2-44c0-8ea2-e107e8bbce07 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:48.249997 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9cf6d4fd-e5c2-44c0-8ea2-e107e8bbce07 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:48.250423 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9cf6d4fd-e5c2-44c0-8ea2-e107e8bbce07 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:48.272870 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-9cf6d4fd-e5c2-44c0-8ea2-e107e8bbce07 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lazy-loading 'flavor' on Instance uuid 9fbc89ef-8230-45d5-b3ee-efb863e5340e {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:20:48.350875 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9cf6d4fd-e5c2-44c0-8ea2-e107e8bbce07 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "POST /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e/action" status: 200 len: 32 microversion: 2.1 time: 0.117749 Jun 28 03:20:48.351506 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 209/419] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:20:48 2022] POST /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e/action => generated 32 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 03:20:48.360927 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7c285260-b4de-47a5-9a14-599507be1cb3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:48.361555 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7c285260-b4de-47a5-9a14-599507be1cb3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:48.367716 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7c285260-b4de-47a5-9a14-599507be1cb3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:48.368177 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7c285260-b4de-47a5-9a14-599507be1cb3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:48.368932 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7c285260-b4de-47a5-9a14-599507be1cb3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:48.369381 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7c285260-b4de-47a5-9a14-599507be1cb3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:48.501477 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7c285260-b4de-47a5-9a14-599507be1cb3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:48.509024 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7c285260-b4de-47a5-9a14-599507be1cb3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.152216 Jun 28 03:20:48.509556 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 211/420] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:48 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:48.883723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d1f86847-71af-49be-8969-04b7e419eac4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:48.884403 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d1f86847-71af-49be-8969-04b7e419eac4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:48.891230 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d1f86847-71af-49be-8969-04b7e419eac4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:48.891661 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d1f86847-71af-49be-8969-04b7e419eac4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:48.892449 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d1f86847-71af-49be-8969-04b7e419eac4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:48.892971 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d1f86847-71af-49be-8969-04b7e419eac4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:49.027853 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d1f86847-71af-49be-8969-04b7e419eac4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:49.037462 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d1f86847-71af-49be-8969-04b7e419eac4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:49.038846 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d1f86847-71af-49be-8969-04b7e419eac4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:49.040172 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d1f86847-71af-49be-8969-04b7e419eac4 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.160807 Jun 28 03:20:49.040697 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 210/421] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:48 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:49.125893 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9260a0ae-8348-408b-a91e-e8a0d859b829 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:49.126498 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-9260a0ae-8348-408b-a91e-e8a0d859b829 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:49.133554 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9260a0ae-8348-408b-a91e-e8a0d859b829 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:49.134002 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9260a0ae-8348-408b-a91e-e8a0d859b829 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:49.134754 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9260a0ae-8348-408b-a91e-e8a0d859b829 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:49.135177 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9260a0ae-8348-408b-a91e-e8a0d859b829 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:49.273398 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9260a0ae-8348-408b-a91e-e8a0d859b829 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:49.281249 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-9260a0ae-8348-408b-a91e-e8a0d859b829 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1444 microversion: 2.1 time: 0.159835 Jun 28 03:20:49.281817 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 212/422] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:49 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:49.300914 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7c708878-1aea-4359-b50c-43bac9b0de45 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:49.301678 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7c708878-1aea-4359-b50c-43bac9b0de45 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:49.310826 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7c708878-1aea-4359-b50c-43bac9b0de45 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:49.311507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7c708878-1aea-4359-b50c-43bac9b0de45 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:49.312795 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7c708878-1aea-4359-b50c-43bac9b0de45 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:49.313345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7c708878-1aea-4359-b50c-43bac9b0de45 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:49.456000 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7c708878-1aea-4359-b50c-43bac9b0de45 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:49.463995 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7c708878-1aea-4359-b50c-43bac9b0de45 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1444 microversion: 2.1 time: 0.169563 Jun 28 03:20:49.464591 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 211/423] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:49 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1444 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:49.525636 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-05ce012f-d1f8-465a-91c6-c485666d320c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:49.526238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-05ce012f-d1f8-465a-91c6-c485666d320c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:49.532877 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-05ce012f-d1f8-465a-91c6-c485666d320c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:49.533314 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-05ce012f-d1f8-465a-91c6-c485666d320c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:49.534031 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-05ce012f-d1f8-465a-91c6-c485666d320c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:49.534453 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-05ce012f-d1f8-465a-91c6-c485666d320c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:49.699698 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-05ce012f-d1f8-465a-91c6-c485666d320c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:49.707763 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-05ce012f-d1f8-465a-91c6-c485666d320c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.185958 Jun 28 03:20:49.708592 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 213/424] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:49 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:50.059125 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9c175dbd-ffd6-4055-881e-eeced92e79a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:50.060094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9c175dbd-ffd6-4055-881e-eeced92e79a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:50.066226 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9c175dbd-ffd6-4055-881e-eeced92e79a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:50.066704 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9c175dbd-ffd6-4055-881e-eeced92e79a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:50.067469 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9c175dbd-ffd6-4055-881e-eeced92e79a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:50.067920 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9c175dbd-ffd6-4055-881e-eeced92e79a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:50.205230 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9c175dbd-ffd6-4055-881e-eeced92e79a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:50.218536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9c175dbd-ffd6-4055-881e-eeced92e79a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:50.220007 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9c175dbd-ffd6-4055-881e-eeced92e79a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:50.221403 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9c175dbd-ffd6-4055-881e-eeced92e79a1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.166446 Jun 28 03:20:50.221742 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 212/425] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:50 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:50.725752 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8974a34f-841f-450f-b3fa-2ee1ef197d65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:50.726346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-8974a34f-841f-450f-b3fa-2ee1ef197d65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:50.734158 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8974a34f-841f-450f-b3fa-2ee1ef197d65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:50.734607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8974a34f-841f-450f-b3fa-2ee1ef197d65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:50.735383 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8974a34f-841f-450f-b3fa-2ee1ef197d65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:50.735840 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8974a34f-841f-450f-b3fa-2ee1ef197d65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:50.877518 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-8974a34f-841f-450f-b3fa-2ee1ef197d65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:50.885414 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-8974a34f-841f-450f-b3fa-2ee1ef197d65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.163803 Jun 28 03:20:50.886010 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 214/426] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:50 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:51.239712 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3780a086-9986-47e2-88ef-af7a70460de9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:51.240457 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3780a086-9986-47e2-88ef-af7a70460de9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:51.242540 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=88 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:51.248319 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3780a086-9986-47e2-88ef-af7a70460de9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:51.248761 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3780a086-9986-47e2-88ef-af7a70460de9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:51.249659 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3780a086-9986-47e2-88ef-af7a70460de9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:51.250101 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3780a086-9986-47e2-88ef-af7a70460de9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:51.389704 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3780a086-9986-47e2-88ef-af7a70460de9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:51.398506 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3780a086-9986-47e2-88ef-af7a70460de9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:51.400006 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3780a086-9986-47e2-88ef-af7a70460de9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:51.401187 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3780a086-9986-47e2-88ef-af7a70460de9 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.165614 Jun 28 03:20:51.401776 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 213/427] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:51 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:51.879885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-9ecf4f5f-ca10-4af7-8df4-8c923ff7db67 req-8d91a959-2d32-4485-bcf5-60497797bfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d20165-bd26-4933-9494-f57e12a4af62", "tag": "5ef0c0c3-3a01-4e07-9e58-af12fe750d01"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:51.888925 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-9ecf4f5f-ca10-4af7-8df4-8c923ff7db67 req-8d91a959-2d32-4485-bcf5-60497797bfe8 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:51.889357 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-9ecf4f5f-ca10-4af7-8df4-8c923ff7db67 req-8d91a959-2d32-4485-bcf5-60497797bfe8 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:51.900764 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-9ecf4f5f-ca10-4af7-8df4-8c923ff7db67 req-8d91a959-2d32-4485-bcf5-60497797bfe8 service nova] Creating event network-changed:5ef0c0c3-3a01-4e07-9e58-af12fe750d01 for instance 18d20165-bd26-4933-9494-f57e12a4af62 on hv-cinder-84684 Jun 28 03:20:51.904109 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a7044cc5-17a3-4431-8622-19f97c2dceb5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:51.906135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-9ecf4f5f-ca10-4af7-8df4-8c923ff7db67 req-8d91a959-2d32-4485-bcf5-60497797bfe8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029750 Jun 28 03:20:51.906761 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a7044cc5-17a3-4431-8622-19f97c2dceb5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:51.910168 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 215/428] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:20:51.916136 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a7044cc5-17a3-4431-8622-19f97c2dceb5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:51.916917 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a7044cc5-17a3-4431-8622-19f97c2dceb5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:51.917778 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a7044cc5-17a3-4431-8622-19f97c2dceb5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:51.918400 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a7044cc5-17a3-4431-8622-19f97c2dceb5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:52.134554 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a7044cc5-17a3-4431-8622-19f97c2dceb5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:52.136960 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:52.143969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a7044cc5-17a3-4431-8622-19f97c2dceb5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.245226 Jun 28 03:20:52.153771 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 214/429] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:51 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:52.419791 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-09baff80-4605-4a7a-97fa-6584d564ee41 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:52.420529 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-09baff80-4605-4a7a-97fa-6584d564ee41 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:52.429116 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-09baff80-4605-4a7a-97fa-6584d564ee41 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:52.429842 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-09baff80-4605-4a7a-97fa-6584d564ee41 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:52.430628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-09baff80-4605-4a7a-97fa-6584d564ee41 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:52.431213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-09baff80-4605-4a7a-97fa-6584d564ee41 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:52.573687 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-09baff80-4605-4a7a-97fa-6584d564ee41 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:52.582451 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-09baff80-4605-4a7a-97fa-6584d564ee41 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:52.583913 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-09baff80-4605-4a7a-97fa-6584d564ee41 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:52.585085 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-09baff80-4605-4a7a-97fa-6584d564ee41 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.169806 Jun 28 03:20:52.585639 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 216/430] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:52 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:53.161731 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-51e76ee9-5183-4131-92ff-3f7ada5c9ff6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:53.162331 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-51e76ee9-5183-4131-92ff-3f7ada5c9ff6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:53.169761 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51e76ee9-5183-4131-92ff-3f7ada5c9ff6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:53.170214 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51e76ee9-5183-4131-92ff-3f7ada5c9ff6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:53.170980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51e76ee9-5183-4131-92ff-3f7ada5c9ff6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:53.171401 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51e76ee9-5183-4131-92ff-3f7ada5c9ff6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:53.312404 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-51e76ee9-5183-4131-92ff-3f7ada5c9ff6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:53.323445 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-51e76ee9-5183-4131-92ff-3f7ada5c9ff6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.165304 Jun 28 03:20:53.324012 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 215/431] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:53 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:53.604869 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-23a3c15e-4a07-4862-adf5-a7e618faf839 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:53.605456 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-23a3c15e-4a07-4862-adf5-a7e618faf839 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:53.613100 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-23a3c15e-4a07-4862-adf5-a7e618faf839 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:53.613539 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-23a3c15e-4a07-4862-adf5-a7e618faf839 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:53.614285 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-23a3c15e-4a07-4862-adf5-a7e618faf839 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:53.614708 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-23a3c15e-4a07-4862-adf5-a7e618faf839 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:53.744627 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-23a3c15e-4a07-4862-adf5-a7e618faf839 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:53.757885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-23a3c15e-4a07-4862-adf5-a7e618faf839 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:53.759635 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-23a3c15e-4a07-4862-adf5-a7e618faf839 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:53.761042 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-23a3c15e-4a07-4862-adf5-a7e618faf839 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.160195 Jun 28 03:20:53.761679 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 217/432] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:53 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:54.342264 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-28ac9ded-16e2-4389-9302-65c9d65d7634 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:54.342974 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-28ac9ded-16e2-4389-9302-65c9d65d7634 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:54.349294 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-28ac9ded-16e2-4389-9302-65c9d65d7634 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:54.349768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-28ac9ded-16e2-4389-9302-65c9d65d7634 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:54.350511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-28ac9ded-16e2-4389-9302-65c9d65d7634 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:54.350930 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-28ac9ded-16e2-4389-9302-65c9d65d7634 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:54.493997 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-28ac9ded-16e2-4389-9302-65c9d65d7634 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:54.506351 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-28ac9ded-16e2-4389-9302-65c9d65d7634 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.168592 Jun 28 03:20:54.507123 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 216/433] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:54 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:54.779557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-08892f08-cb00-4446-b24e-41a450990190 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:54.780080 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-08892f08-cb00-4446-b24e-41a450990190 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:54.786822 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-08892f08-cb00-4446-b24e-41a450990190 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:54.787269 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-08892f08-cb00-4446-b24e-41a450990190 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:54.788029 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-08892f08-cb00-4446-b24e-41a450990190 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:54.788482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-08892f08-cb00-4446-b24e-41a450990190 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:54.938780 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-08892f08-cb00-4446-b24e-41a450990190 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:54.947512 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-08892f08-cb00-4446-b24e-41a450990190 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:54.949023 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-08892f08-cb00-4446-b24e-41a450990190 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:54.950186 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-08892f08-cb00-4446-b24e-41a450990190 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.174925 Jun 28 03:20:54.950877 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 218/434] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:54 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:55.153461 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-765491cd-b71c-44d6-8540-29d22ca8152d req-4799cd46-e293-44ce-983f-9feda4b7fdea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f3fd86-9d6c-4d2e-8997-579c77adc3f0", "name": "network-vif-plugged", "status": "completed", "tag": "9e28a86b-c03c-4271-880f-a8d72e9df423"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:20:55.161937 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-765491cd-b71c-44d6-8540-29d22ca8152d req-4799cd46-e293-44ce-983f-9feda4b7fdea service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:55.162367 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-765491cd-b71c-44d6-8540-29d22ca8152d req-4799cd46-e293-44ce-983f-9feda4b7fdea service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:55.174048 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-765491cd-b71c-44d6-8540-29d22ca8152d req-4799cd46-e293-44ce-983f-9feda4b7fdea service nova] Creating event network-vif-plugged:9e28a86b-c03c-4271-880f-a8d72e9df423 for instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 on hv-cinder-84684 Jun 28 03:20:55.178931 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-765491cd-b71c-44d6-8540-29d22ca8152d req-4799cd46-e293-44ce-983f-9feda4b7fdea service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029266 Jun 28 03:20:55.179571 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 217/435] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:20:55.527618 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6f7fb0c1-123e-43b6-9f27-80c3f52a03ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:55.528349 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6f7fb0c1-123e-43b6-9f27-80c3f52a03ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:55.530804 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=78 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:55.537326 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6f7fb0c1-123e-43b6-9f27-80c3f52a03ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:55.537844 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6f7fb0c1-123e-43b6-9f27-80c3f52a03ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:55.538733 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6f7fb0c1-123e-43b6-9f27-80c3f52a03ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:55.539234 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6f7fb0c1-123e-43b6-9f27-80c3f52a03ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:55.677353 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6f7fb0c1-123e-43b6-9f27-80c3f52a03ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:55.685348 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6f7fb0c1-123e-43b6-9f27-80c3f52a03ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.162376 Jun 28 03:20:55.685911 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 219/436] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:55 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:55.970011 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-206cbab4-fcee-42d4-88bd-722b94144091 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:55.970748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-206cbab4-fcee-42d4-88bd-722b94144091 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:55.977468 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-206cbab4-fcee-42d4-88bd-722b94144091 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:55.977907 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-206cbab4-fcee-42d4-88bd-722b94144091 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:55.978694 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-206cbab4-fcee-42d4-88bd-722b94144091 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:55.979119 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-206cbab4-fcee-42d4-88bd-722b94144091 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:56.119584 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-206cbab4-fcee-42d4-88bd-722b94144091 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:56.128531 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-206cbab4-fcee-42d4-88bd-722b94144091 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:56.129990 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-206cbab4-fcee-42d4-88bd-722b94144091 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:56.131148 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-206cbab4-fcee-42d4-88bd-722b94144091 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.165600 Jun 28 03:20:56.131692 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 218/437] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:55 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:56.705576 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-229a2d93-5675-4182-9fb0-fbf90300d0e3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:56.706231 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-229a2d93-5675-4182-9fb0-fbf90300d0e3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:56.713881 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-229a2d93-5675-4182-9fb0-fbf90300d0e3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:56.714364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-229a2d93-5675-4182-9fb0-fbf90300d0e3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:56.715193 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-229a2d93-5675-4182-9fb0-fbf90300d0e3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:56.715659 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-229a2d93-5675-4182-9fb0-fbf90300d0e3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:56.718584 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=100 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:20:56.854915 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-229a2d93-5675-4182-9fb0-fbf90300d0e3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:56.863149 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-229a2d93-5675-4182-9fb0-fbf90300d0e3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.162728 Jun 28 03:20:56.863687 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 220/438] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:56 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:57.151312 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c1404c4d-d28a-48b4-a5df-af540252f4d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:57.152068 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c1404c4d-d28a-48b4-a5df-af540252f4d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:57.159145 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c1404c4d-d28a-48b4-a5df-af540252f4d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:57.159588 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c1404c4d-d28a-48b4-a5df-af540252f4d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:57.160368 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c1404c4d-d28a-48b4-a5df-af540252f4d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:57.160804 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c1404c4d-d28a-48b4-a5df-af540252f4d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:57.295216 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c1404c4d-d28a-48b4-a5df-af540252f4d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:57.303677 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c1404c4d-d28a-48b4-a5df-af540252f4d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:57.305165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c1404c4d-d28a-48b4-a5df-af540252f4d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:57.306319 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c1404c4d-d28a-48b4-a5df-af540252f4d1 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.160035 Jun 28 03:20:57.306869 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 219/439] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:57 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:57.879932 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4ecff057-1a00-427f-8d06-259b51fbea64 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:57.880541 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4ecff057-1a00-427f-8d06-259b51fbea64 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:57.887586 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4ecff057-1a00-427f-8d06-259b51fbea64 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:57.888029 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4ecff057-1a00-427f-8d06-259b51fbea64 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:57.888852 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4ecff057-1a00-427f-8d06-259b51fbea64 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:57.889283 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4ecff057-1a00-427f-8d06-259b51fbea64 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:58.027729 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4ecff057-1a00-427f-8d06-259b51fbea64 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:58.037049 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4ecff057-1a00-427f-8d06-259b51fbea64 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.161046 Jun 28 03:20:58.037727 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 221/440] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:57 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:58.325051 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d2538f68-40c6-44fa-93bb-613c94089eab tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:58.325735 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d2538f68-40c6-44fa-93bb-613c94089eab tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:58.332397 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d2538f68-40c6-44fa-93bb-613c94089eab tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:58.332805 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d2538f68-40c6-44fa-93bb-613c94089eab tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:58.333913 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d2538f68-40c6-44fa-93bb-613c94089eab tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:58.334016 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d2538f68-40c6-44fa-93bb-613c94089eab tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:58.465608 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d2538f68-40c6-44fa-93bb-613c94089eab tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:58.474425 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d2538f68-40c6-44fa-93bb-613c94089eab tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:58.475889 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d2538f68-40c6-44fa-93bb-613c94089eab tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:58.477052 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d2538f68-40c6-44fa-93bb-613c94089eab tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1809 microversion: 2.20 time: 0.155995 Jun 28 03:20:58.477662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 220/441] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:58 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:20:59.058441 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-97ddf08d-c96b-40ac-8f99-2ca1419cc8a3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:59.059434 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-97ddf08d-c96b-40ac-8f99-2ca1419cc8a3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:59.070865 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-97ddf08d-c96b-40ac-8f99-2ca1419cc8a3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:59.071608 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-97ddf08d-c96b-40ac-8f99-2ca1419cc8a3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:59.073081 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-97ddf08d-c96b-40ac-8f99-2ca1419cc8a3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:59.073847 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-97ddf08d-c96b-40ac-8f99-2ca1419cc8a3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:59.214273 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-97ddf08d-c96b-40ac-8f99-2ca1419cc8a3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:59.221997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-97ddf08d-c96b-40ac-8f99-2ca1419cc8a3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.170045 Jun 28 03:20:59.222556 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 222/442] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:20:59 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:20:59.499951 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-05f35ce3-3682-4533-9d7e-bac6f17d32da tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:20:59.500687 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-05f35ce3-3682-4533-9d7e-bac6f17d32da tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:20:59.508188 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-05f35ce3-3682-4533-9d7e-bac6f17d32da tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:59.508720 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-05f35ce3-3682-4533-9d7e-bac6f17d32da tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:59.509594 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-05f35ce3-3682-4533-9d7e-bac6f17d32da tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:20:59.510099 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-05f35ce3-3682-4533-9d7e-bac6f17d32da tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:20:59.643573 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-05f35ce3-3682-4533-9d7e-bac6f17d32da tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:59.652452 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-05f35ce3-3682-4533-9d7e-bac6f17d32da tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:59.653925 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-05f35ce3-3682-4533-9d7e-bac6f17d32da tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:20:59.655228 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-05f35ce3-3682-4533-9d7e-bac6f17d32da tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1796 microversion: 2.20 time: 0.161758 Jun 28 03:20:59.655781 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 221/443] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:20:59 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1796 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:21:00.243293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9a8a47b4-df52-49cc-9a52-ef8231b5a87a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:00.244203 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-9a8a47b4-df52-49cc-9a52-ef8231b5a87a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:00.253728 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9a8a47b4-df52-49cc-9a52-ef8231b5a87a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:00.254176 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9a8a47b4-df52-49cc-9a52-ef8231b5a87a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:00.254955 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9a8a47b4-df52-49cc-9a52-ef8231b5a87a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:00.255375 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9a8a47b4-df52-49cc-9a52-ef8231b5a87a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:00.397254 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9a8a47b4-df52-49cc-9a52-ef8231b5a87a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:00.405114 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-9a8a47b4-df52-49cc-9a52-ef8231b5a87a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.167847 Jun 28 03:21:00.405697 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 223/444] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:00 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:01.425158 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b553dd04-03d9-4641-9f38-3709ba0379e2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:01.426022 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b553dd04-03d9-4641-9f38-3709ba0379e2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:01.434054 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b553dd04-03d9-4641-9f38-3709ba0379e2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:01.434603 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b553dd04-03d9-4641-9f38-3709ba0379e2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:01.435587 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b553dd04-03d9-4641-9f38-3709ba0379e2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:01.436292 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b553dd04-03d9-4641-9f38-3709ba0379e2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:01.570353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b553dd04-03d9-4641-9f38-3709ba0379e2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:01.581963 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b553dd04-03d9-4641-9f38-3709ba0379e2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.161827 Jun 28 03:21:01.582799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 222/445] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:01 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:02.600977 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e7883b39-229b-4504-a532-a5dbc1f6192f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:02.601677 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e7883b39-229b-4504-a532-a5dbc1f6192f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:02.610370 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e7883b39-229b-4504-a532-a5dbc1f6192f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:02.610896 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e7883b39-229b-4504-a532-a5dbc1f6192f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:02.611779 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e7883b39-229b-4504-a532-a5dbc1f6192f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:02.612346 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e7883b39-229b-4504-a532-a5dbc1f6192f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:02.751704 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e7883b39-229b-4504-a532-a5dbc1f6192f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:02.759685 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e7883b39-229b-4504-a532-a5dbc1f6192f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.163379 Jun 28 03:21:02.760287 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 224/446] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:02 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:03.777592 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8b5b46b2-ebbe-4568-bade-4b993067fba4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:03.778192 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8b5b46b2-ebbe-4568-bade-4b993067fba4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:03.784996 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8b5b46b2-ebbe-4568-bade-4b993067fba4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:03.785411 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8b5b46b2-ebbe-4568-bade-4b993067fba4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:03.786196 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8b5b46b2-ebbe-4568-bade-4b993067fba4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:03.786625 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8b5b46b2-ebbe-4568-bade-4b993067fba4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:03.922910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8b5b46b2-ebbe-4568-bade-4b993067fba4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:03.930508 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8b5b46b2-ebbe-4568-bade-4b993067fba4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.156840 Jun 28 03:21:03.931062 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 223/447] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:03 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:04.951842 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2fe7e626-5239-447c-9280-478843e7c104 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:04.953041 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2fe7e626-5239-447c-9280-478843e7c104 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:04.962295 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2fe7e626-5239-447c-9280-478843e7c104 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:04.962875 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2fe7e626-5239-447c-9280-478843e7c104 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:04.963868 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2fe7e626-5239-447c-9280-478843e7c104 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:04.964481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2fe7e626-5239-447c-9280-478843e7c104 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:05.111022 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2fe7e626-5239-447c-9280-478843e7c104 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:05.118740 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2fe7e626-5239-447c-9280-478843e7c104 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.173309 Jun 28 03:21:05.119302 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 225/448] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:04 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:06.136414 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4e6bd301-8928-4cc7-b29b-d82a020eda37 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:06.137029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4e6bd301-8928-4cc7-b29b-d82a020eda37 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:06.143603 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e6bd301-8928-4cc7-b29b-d82a020eda37 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:06.144072 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e6bd301-8928-4cc7-b29b-d82a020eda37 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:06.144862 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e6bd301-8928-4cc7-b29b-d82a020eda37 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:06.145287 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e6bd301-8928-4cc7-b29b-d82a020eda37 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:06.281531 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4e6bd301-8928-4cc7-b29b-d82a020eda37 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:06.289529 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4e6bd301-8928-4cc7-b29b-d82a020eda37 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.157163 Jun 28 03:21:06.290074 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 224/449] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:06 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:07.310614 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-725f1302-cbbb-4aa0-9c5d-9c636e9e24ea tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:07.311573 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-725f1302-cbbb-4aa0-9c5d-9c636e9e24ea tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:07.323354 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-725f1302-cbbb-4aa0-9c5d-9c636e9e24ea tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:07.324077 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-725f1302-cbbb-4aa0-9c5d-9c636e9e24ea tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:07.325366 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-725f1302-cbbb-4aa0-9c5d-9c636e9e24ea tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:07.326063 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-725f1302-cbbb-4aa0-9c5d-9c636e9e24ea tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:07.477376 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-725f1302-cbbb-4aa0-9c5d-9c636e9e24ea tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:07.486093 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-725f1302-cbbb-4aa0-9c5d-9c636e9e24ea tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.182044 Jun 28 03:21:07.486655 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 226/450] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:07 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:08.503826 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9a3fab2e-1cd5-421e-9dd5-507ffc75ca74 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:08.504456 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9a3fab2e-1cd5-421e-9dd5-507ffc75ca74 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:08.510789 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9a3fab2e-1cd5-421e-9dd5-507ffc75ca74 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:08.511238 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9a3fab2e-1cd5-421e-9dd5-507ffc75ca74 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:08.511989 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9a3fab2e-1cd5-421e-9dd5-507ffc75ca74 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:08.512419 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9a3fab2e-1cd5-421e-9dd5-507ffc75ca74 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:08.657987 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9a3fab2e-1cd5-421e-9dd5-507ffc75ca74 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:08.670632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9a3fab2e-1cd5-421e-9dd5-507ffc75ca74 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.171142 Jun 28 03:21:08.671809 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 225/451] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:08 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:09.692880 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e318e422-2620-426e-b487-0511ccf552f0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:09.693847 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e318e422-2620-426e-b487-0511ccf552f0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:09.704364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e318e422-2620-426e-b487-0511ccf552f0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:09.704807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e318e422-2620-426e-b487-0511ccf552f0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:09.705556 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e318e422-2620-426e-b487-0511ccf552f0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:09.705980 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e318e422-2620-426e-b487-0511ccf552f0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:09.839117 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e318e422-2620-426e-b487-0511ccf552f0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:09.850479 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e318e422-2620-426e-b487-0511ccf552f0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.164569 Jun 28 03:21:09.851052 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 227/452] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:09 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:10.365579 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1fa94303-f348-461d-9d6e-ac69d0c1e041 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:10.366440 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1fa94303-f348-461d-9d6e-ac69d0c1e041 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:10.372616 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1fa94303-f348-461d-9d6e-ac69d0c1e041 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:10.372796 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1fa94303-f348-461d-9d6e-ac69d0c1e041 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:10.373477 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1fa94303-f348-461d-9d6e-ac69d0c1e041 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:10.373901 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1fa94303-f348-461d-9d6e-ac69d0c1e041 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:10.398416 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1fa94303-f348-461d-9d6e-ac69d0c1e041 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27/ips" status: 200 len: 148 microversion: 2.1 time: 0.036773 Jun 28 03:21:10.399006 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 226/453] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 28 03:21:10 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:21:10.409666 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-504f5213-86a7-4145-b253-a033bdfad313 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53ab0343-5b6c-4519-aa43-54df07ed0660"}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:10.410915 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-504f5213-86a7-4145-b253-a033bdfad313 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:10.417534 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-504f5213-86a7-4145-b253-a033bdfad313 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:10.417957 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-504f5213-86a7-4145-b253-a033bdfad313 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:10.418711 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-504f5213-86a7-4145-b253-a033bdfad313 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:10.419141 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-504f5213-86a7-4145-b253-a033bdfad313 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:10.502166 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-504f5213-86a7-4145-b253-a033bdfad313 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Invalid volume: volume 53ab0343-5b6c-4519-aa43-54df07ed0660 is already attached to instances: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-504f5213-86a7-4145-b253-a033bdfad313 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: POST /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27/os-volume_attachments HTTP/1.1 Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 74 Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:21:10.504251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:21:10.505838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:21:10.505838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:21:10.505838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:21:10.505838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:21:10.505838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:21:10.505838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:21:10.505838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:21:10.505838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:21:10.505838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:21:10.505838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Jun 28 03:21:10.505838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {"volumeAttachment": {"volumeId": "53ab0343-5b6c-4519-aa43-54df07ed0660"}} Jun 28 03:21:10.505838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Invalid volume: volume 53ab0343-5b6c-4519-aa43-54df07ed0660 is already attached to instances: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'server_id': '72b33cdf-def8-4dff-a771-d3e795fa0c27', 'body': {'volumeAttachment': {'volumeId': '53ab0343-5b6c-4519-aa43-54df07ed0660'}}} Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 53ab0343-5b6c-4519-aa43-54df07ed0660 is already attached to instances: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:10.506757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 53ab0343-5b6c-4519-aa43-54df07ed0660 is already attached to instances: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:10.508313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:21:10.509776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:21:10.509776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:21:10.509776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:21:10.509776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 53ab0343-5b6c-4519-aa43-54df07ed0660 is already attached to instances: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e Jun 28 03:21:10.509776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:10.509776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-504f5213-86a7-4145-b253-a033bdfad313 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 400 to user: Invalid volume: volume 53ab0343-5b6c-4519-aa43-54df07ed0660 is already attached to instances: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:21:10.509776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-504f5213-86a7-4145-b253-a033bdfad313 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "POST /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100187 Jun 28 03:21:10.509776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 228/454] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:21:10 2022] POST /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 28 03:21:10.514663 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d92fe7e8-f839-4b07-be0b-e1b4625aae88 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:10.515265 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d92fe7e8-f839-4b07-be0b-e1b4625aae88 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:10.522262 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d92fe7e8-f839-4b07-be0b-e1b4625aae88 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:10.522702 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d92fe7e8-f839-4b07-be0b-e1b4625aae88 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:10.523465 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d92fe7e8-f839-4b07-be0b-e1b4625aae88 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:10.523890 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d92fe7e8-f839-4b07-be0b-e1b4625aae88 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:10.549362 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d92fe7e8-f839-4b07-be0b-e1b4625aae88 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:21:10.632652 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d92fe7e8-f839-4b07-be0b-e1b4625aae88 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 204 len: 0 microversion: 2.1 time: 0.121509 Jun 28 03:21:10.633305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 227/455] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:21:10 2022] DELETE /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:21:10.641598 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-49781e17-c517-46d2-a1e8-3e619c73b6e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:10.642291 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-49781e17-c517-46d2-a1e8-3e619c73b6e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:10.648598 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-49781e17-c517-46d2-a1e8-3e619c73b6e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:10.649035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-49781e17-c517-46d2-a1e8-3e619c73b6e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:10.649785 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-49781e17-c517-46d2-a1e8-3e619c73b6e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:10.650211 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-49781e17-c517-46d2-a1e8-3e619c73b6e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:10.783340 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-49781e17-c517-46d2-a1e8-3e619c73b6e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:10.791588 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-49781e17-c517-46d2-a1e8-3e619c73b6e3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1678 microversion: 2.1 time: 0.153862 Jun 28 03:21:10.792130 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 229/456] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:10 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:10.874608 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a2bb6b97-e65c-404c-bbee-bf9a9ddb2ec4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:10.875327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a2bb6b97-e65c-404c-bbee-bf9a9ddb2ec4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:10.881842 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2bb6b97-e65c-404c-bbee-bf9a9ddb2ec4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:10.882281 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2bb6b97-e65c-404c-bbee-bf9a9ddb2ec4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:10.883089 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2bb6b97-e65c-404c-bbee-bf9a9ddb2ec4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:10.883447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2bb6b97-e65c-404c-bbee-bf9a9ddb2ec4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:11.033556 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a2bb6b97-e65c-404c-bbee-bf9a9ddb2ec4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:11.041149 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a2bb6b97-e65c-404c-bbee-bf9a9ddb2ec4 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1502 microversion: 2.1 time: 0.173764 Jun 28 03:21:11.041708 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 228/457] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:10 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:11.057623 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-908c3421-cea1-4669-922b-bdfcf8d4a087 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "343f4b13-873c-4e72-a9fe-08c0c08d640a"}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:11.058788 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-908c3421-cea1-4669-922b-bdfcf8d4a087 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:11.065539 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-908c3421-cea1-4669-922b-bdfcf8d4a087 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:11.065988 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-908c3421-cea1-4669-922b-bdfcf8d4a087 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:11.066752 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-908c3421-cea1-4669-922b-bdfcf8d4a087 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:11.067188 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-908c3421-cea1-4669-922b-bdfcf8d4a087 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:11.091642 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-908c3421-cea1-4669-922b-bdfcf8d4a087 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] HTTP exception thrown: Cannot 'attach_volume' instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e while it is in vm_state rescued Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-908c3421-cea1-4669-922b-bdfcf8d4a087 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Request method failure captured: Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: POST /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e/os-volume_attachments HTTP/1.1 Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 74 Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunM9Dd2r6ks5CIlIc9oHLOKluAAH5hNuDeG-EEwuyeKomrNFLTxgh-zrC0miKybndMxw9Cdi-BV0GgnKfutXJVMSeZgCSN-M0pbBhLprVRMibFfdu2RtmOFIDlDK49KX0XgdbKcGw2_LDDpApk_-py0nMs4uP1Q9olzEBrp7uDcYaAI Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: c1e596746cc64a1981804d95f1906bb3 Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:21:11.093238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:21:11.095876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c1e596746cc64a1981804d95f1906bb3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:21:11.095876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:21:11.095876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: c1e596746cc64a1981804d95f1906bb3 Jun 28 03:21:11.095876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:21:11.095876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-ServerRescueNegativeTestJSON-1266345582-project Jun 28 03:21:11.095876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:21:11.095876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:21:11.095876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: facb00bcd5644550a93901791f77b89c Jun 28 03:21:11.095876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1266345582-project Jun 28 03:21:11.095876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Jun 28 03:21:11.095876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {"volumeAttachment": {"volumeId": "343f4b13-873c-4e72-a9fe-08c0c08d640a"}} Jun 28 03:21:11.095876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Cannot 'attach_volume' instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e while it is in vm_state rescued Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'server_id': '9fbc89ef-8230-45d5-b3ee-efb863e5340e', 'body': {'volumeAttachment': {'volumeId': '343f4b13-873c-4e72-a9fe-08c0c08d640a'}}} Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:21:11.096737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e while it is in vm_state rescued Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:21:11.097807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:21:11.098981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:21:11.098981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:21:11.098981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e while it is in vm_state rescued Jun 28 03:21:11.098981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:11.098981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-908c3421-cea1-4669-922b-bdfcf8d4a087 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Returning 409 to user: Cannot 'attach_volume' instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e while it is in vm_state rescued {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:21:11.098981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-908c3421-cea1-4669-922b-bdfcf8d4a087 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "POST /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041565 Jun 28 03:21:11.098981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 230/458] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:21:11 2022] POST /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 28 03:21:11.103911 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2493ac22-95ac-4fc8-988b-ff183e4aee08 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:11.104464 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2493ac22-95ac-4fc8-988b-ff183e4aee08 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:11.111570 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2493ac22-95ac-4fc8-988b-ff183e4aee08 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:11.112009 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2493ac22-95ac-4fc8-988b-ff183e4aee08 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:11.112787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2493ac22-95ac-4fc8-988b-ff183e4aee08 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:11.113213 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2493ac22-95ac-4fc8-988b-ff183e4aee08 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:11.171570 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:11.183556 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2493ac22-95ac-4fc8-988b-ff183e4aee08 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "POST /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e/action" status: 202 len: 0 microversion: 2.1 time: 0.083393 Jun 28 03:21:11.184192 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 229/459] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:21:11 2022] POST /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:21:11.195434 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c871e251-5519-4f78-8ab1-166fe6dda094 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:11.196459 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c871e251-5519-4f78-8ab1-166fe6dda094 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:11.205178 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c871e251-5519-4f78-8ab1-166fe6dda094 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:11.205620 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c871e251-5519-4f78-8ab1-166fe6dda094 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:11.206373 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c871e251-5519-4f78-8ab1-166fe6dda094 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:11.206804 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c871e251-5519-4f78-8ab1-166fe6dda094 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:11.344971 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c871e251-5519-4f78-8ab1-166fe6dda094 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:11.352617 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c871e251-5519-4f78-8ab1-166fe6dda094 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1510 microversion: 2.1 time: 0.163353 Jun 28 03:21:11.353172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 231/460] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:11 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:11.814762 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4011dd2c-904e-45fb-bc27-f197501bbe9c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:11.815895 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4011dd2c-904e-45fb-bc27-f197501bbe9c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:11.827280 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4011dd2c-904e-45fb-bc27-f197501bbe9c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:11.828251 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4011dd2c-904e-45fb-bc27-f197501bbe9c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:11.829085 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4011dd2c-904e-45fb-bc27-f197501bbe9c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:11.829559 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4011dd2c-904e-45fb-bc27-f197501bbe9c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:11.972353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4011dd2c-904e-45fb-bc27-f197501bbe9c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:11.980537 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4011dd2c-904e-45fb-bc27-f197501bbe9c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1678 microversion: 2.1 time: 0.172950 Jun 28 03:21:11.981110 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 230/461] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:11 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:12.374237 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c0a1805e-eae1-4af8-9077-827c370510f5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:12.375288 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c0a1805e-eae1-4af8-9077-827c370510f5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:12.382426 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c0a1805e-eae1-4af8-9077-827c370510f5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:12.382871 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c0a1805e-eae1-4af8-9077-827c370510f5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:12.383629 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c0a1805e-eae1-4af8-9077-827c370510f5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:12.384045 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c0a1805e-eae1-4af8-9077-827c370510f5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:12.520049 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c0a1805e-eae1-4af8-9077-827c370510f5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:12.531740 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c0a1805e-eae1-4af8-9077-827c370510f5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1510 microversion: 2.1 time: 0.163724 Jun 28 03:21:12.532957 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 232/462] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:12 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:13.001380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9e5d7787-e480-46cf-8ddd-46ca66b04d8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:13.001987 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9e5d7787-e480-46cf-8ddd-46ca66b04d8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:13.008463 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9e5d7787-e480-46cf-8ddd-46ca66b04d8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:13.008905 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9e5d7787-e480-46cf-8ddd-46ca66b04d8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:13.009695 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9e5d7787-e480-46cf-8ddd-46ca66b04d8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:13.010118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9e5d7787-e480-46cf-8ddd-46ca66b04d8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:13.194243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9e5d7787-e480-46cf-8ddd-46ca66b04d8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:13.202218 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9e5d7787-e480-46cf-8ddd-46ca66b04d8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1678 microversion: 2.1 time: 0.206341 Jun 28 03:21:13.202777 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 231/463] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:12 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:13.524860 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-88487f34-1cfe-4107-b84b-ef6fc0817116 req-94c1a6b7-256e-43b6-ad76-113e7350c221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b33cdf-def8-4dff-a771-d3e795fa0c27", "name": "network-vif-deleted", "tag": "d436dd45-4104-4290-a33b-f2fe67047429"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:13.534734 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-88487f34-1cfe-4107-b84b-ef6fc0817116 req-94c1a6b7-256e-43b6-ad76-113e7350c221 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:13.535408 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-88487f34-1cfe-4107-b84b-ef6fc0817116 req-94c1a6b7-256e-43b6-ad76-113e7350c221 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:13.547125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-88487f34-1cfe-4107-b84b-ef6fc0817116 req-94c1a6b7-256e-43b6-ad76-113e7350c221 service nova] Creating event network-vif-deleted:d436dd45-4104-4290-a33b-f2fe67047429 for instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 on hv-cinder-84684 Jun 28 03:21:13.553065 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-88487f34-1cfe-4107-b84b-ef6fc0817116 req-94c1a6b7-256e-43b6-ad76-113e7350c221 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031918 Jun 28 03:21:13.553694 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 233/464] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:13.554972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fb5375ce-f654-4226-9e07-d8fa5dd06ff2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:13.555573 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fb5375ce-f654-4226-9e07-d8fa5dd06ff2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:13.562105 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fb5375ce-f654-4226-9e07-d8fa5dd06ff2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:13.562969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fb5375ce-f654-4226-9e07-d8fa5dd06ff2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:13.563787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fb5375ce-f654-4226-9e07-d8fa5dd06ff2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:13.564243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fb5375ce-f654-4226-9e07-d8fa5dd06ff2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:13.694261 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fb5375ce-f654-4226-9e07-d8fa5dd06ff2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:13.702095 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fb5375ce-f654-4226-9e07-d8fa5dd06ff2 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1510 microversion: 2.1 time: 0.151044 Jun 28 03:21:13.702916 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 232/465] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:13 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:14.223975 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3ffa0d9b-401e-4093-87c2-d0d87b7758ab tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:14.224763 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-3ffa0d9b-401e-4093-87c2-d0d87b7758ab tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:14.231702 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3ffa0d9b-401e-4093-87c2-d0d87b7758ab tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:14.232977 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3ffa0d9b-401e-4093-87c2-d0d87b7758ab tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:14.233750 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3ffa0d9b-401e-4093-87c2-d0d87b7758ab tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:14.234268 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3ffa0d9b-401e-4093-87c2-d0d87b7758ab tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:14.299596 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-3ffa0d9b-401e-4093-87c2-d0d87b7758ab tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:14.307402 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3ffa0d9b-401e-4093-87c2-d0d87b7758ab tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1610 microversion: 2.1 time: 0.087973 Jun 28 03:21:14.307970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 234/466] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:14 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1610 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:14.719895 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ff7a766d-4a6d-4951-a946-2bbf9488526a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:14.720470 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ff7a766d-4a6d-4951-a946-2bbf9488526a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:14.726849 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ff7a766d-4a6d-4951-a946-2bbf9488526a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:14.727366 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ff7a766d-4a6d-4951-a946-2bbf9488526a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:14.728230 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ff7a766d-4a6d-4951-a946-2bbf9488526a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:14.728667 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ff7a766d-4a6d-4951-a946-2bbf9488526a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:14.870674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ff7a766d-4a6d-4951-a946-2bbf9488526a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:14.880891 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ff7a766d-4a6d-4951-a946-2bbf9488526a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1510 microversion: 2.1 time: 0.165653 Jun 28 03:21:14.881644 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 233/467] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:14 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:15.325355 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-06fa86fa-9d0f-4b11-8ac4-9d7c0802f96a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:15.325930 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-06fa86fa-9d0f-4b11-8ac4-9d7c0802f96a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:15.333275 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-06fa86fa-9d0f-4b11-8ac4-9d7c0802f96a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:15.333697 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-06fa86fa-9d0f-4b11-8ac4-9d7c0802f96a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:15.334460 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-06fa86fa-9d0f-4b11-8ac4-9d7c0802f96a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:15.334885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-06fa86fa-9d0f-4b11-8ac4-9d7c0802f96a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:15.372301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-06fa86fa-9d0f-4b11-8ac4-9d7c0802f96a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:15.372301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-06fa86fa-9d0f-4b11-8ac4-9d7c0802f96a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:15.372686 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.objects.instance [None req-06fa86fa-9d0f-4b11-8ac4-9d7c0802f96a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lazy-loading 'fault' on Instance uuid 72b33cdf-def8-4dff-a771-d3e795fa0c27 {{(pid=117681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:21:15.413852 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-06fa86fa-9d0f-4b11-8ac4-9d7c0802f96a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:15.421699 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-06fa86fa-9d0f-4b11-8ac4-9d7c0802f96a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 200 len: 1329 microversion: 2.1 time: 0.100234 Jun 28 03:21:15.422283 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 235/468] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:15 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 1329 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:15.899035 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-db24ad22-9470-4863-8c70-849c7df0a6e8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:15.899605 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-db24ad22-9470-4863-8c70-849c7df0a6e8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:15.906687 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-db24ad22-9470-4863-8c70-849c7df0a6e8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:15.907179 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-db24ad22-9470-4863-8c70-849c7df0a6e8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:15.907937 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-db24ad22-9470-4863-8c70-849c7df0a6e8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:15.908414 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-db24ad22-9470-4863-8c70-849c7df0a6e8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:16.052886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-db24ad22-9470-4863-8c70-849c7df0a6e8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:16.061830 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-db24ad22-9470-4863-8c70-849c7df0a6e8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1516 microversion: 2.1 time: 0.166627 Jun 28 03:21:16.070285 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 234/469] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:15 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:16.439656 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-cf7b8907-9438-46e4-99f5-0aafc220cb95 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:16.440207 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-cf7b8907-9438-46e4-99f5-0aafc220cb95 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:16.446257 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-cf7b8907-9438-46e4-99f5-0aafc220cb95 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:16.446687 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-cf7b8907-9438-46e4-99f5-0aafc220cb95 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:16.447426 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-cf7b8907-9438-46e4-99f5-0aafc220cb95 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:16.447845 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-cf7b8907-9438-46e4-99f5-0aafc220cb95 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:16.461219 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-cf7b8907-9438-46e4-99f5-0aafc220cb95 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-cf7b8907-9438-46e4-99f5-0aafc220cb95 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 HTTP/1.1 Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:21:16.462831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:21:16.464321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:21:16.464321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:21:16.464321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:21:16.464321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:21:16.464321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:21:16.464321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:21:16.464321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:21:16.464321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:21:16.464321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:21:16.464321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:21:16.464321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:21:16.464321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '72b33cdf-def8-4dff-a771-d3e795fa0c27'} Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:21:16.465129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:21:16.466251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:16.467262 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-cf7b8907-9438-46e4-99f5-0aafc220cb95 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 404 to user: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:21:16.467262 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-cf7b8907-9438-46e4-99f5-0aafc220cb95 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 404 len: 111 microversion: 2.1 time: 0.028761 Jun 28 03:21:16.467262 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 236/470] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:16 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:21:16.474348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a5251fd4-3c20-4aa9-8185-ec3da5574e86 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '.version_select at 0x7f53f1c2a430>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:16.497630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a5251fd4-3c20-4aa9-8185-ec3da5574e86 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-748331024" status: 202 len: 0 microversion: 2.1 time: 0.027325 Jun 28 03:21:16.498192 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 235/471] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jun 28 03:21:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-748331024 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:21:17.414508 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-545a2b25-7562-4b00-a425-1c2e16fb265f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Action: 'create', calling method: .version_select at 0x7f53f1f12430>, body: {"keypair": {"name": "tempest-keypair-856977450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqgVsnX2iChkqlLKGtjRPKGK1DkUEd/nn1yCEYPwxTCjthYx2TIIGVlLclol8xhLnrvJyVJ/vOfv9xhb+bqY5mnGhKAEX5YfjURXzXzECkzuflgbLPFtx/hzd0PwrVGCw=="}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:17.428855 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-545a2b25-7562-4b00-a425-1c2e16fb265f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Getting quotas for project c1e596746cc64a1981804d95f1906bb3. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:21:17.432866 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-545a2b25-7562-4b00-a425-1c2e16fb265f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Getting quotas for user facb00bcd5644550a93901791f77b89c and project c1e596746cc64a1981804d95f1906bb3. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:21:17.450055 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a291a7b5-2401-41ce-9594-4cf55a2b6983 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:17.450634 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a291a7b5-2401-41ce-9594-4cf55a2b6983 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:17.456859 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-545a2b25-7562-4b00-a425-1c2e16fb265f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046194 Jun 28 03:21:17.457654 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 237/472] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 28 03:21:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:17.462814 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a291a7b5-2401-41ce-9594-4cf55a2b6983 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:17.463416 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a291a7b5-2401-41ce-9594-4cf55a2b6983 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:17.464345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a291a7b5-2401-41ce-9594-4cf55a2b6983 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:17.464782 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a291a7b5-2401-41ce-9594-4cf55a2b6983 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:17.597396 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-a291a7b5-2401-41ce-9594-4cf55a2b6983 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lazy-loading 'services' on Instance uuid c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:21:17.720747 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a291a7b5-2401-41ce-9594-4cf55a2b6983 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e/os-volume_attachments/53ab0343-5b6c-4519-aa43-54df07ed0660" status: 202 len: 0 microversion: 2.1 time: 0.275286 Jun 28 03:21:17.721336 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 236/473] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 28 03:21:17 2022] DELETE /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e/os-volume_attachments/53ab0343-5b6c-4519-aa43-54df07ed0660 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:21:17.730682 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c8bc0585-ed10-40fe-9787-e7598bc15e06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:17.731803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c8bc0585-ed10-40fe-9787-e7598bc15e06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:17.740283 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c8bc0585-ed10-40fe-9787-e7598bc15e06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:17.740967 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c8bc0585-ed10-40fe-9787-e7598bc15e06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:17.742198 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c8bc0585-ed10-40fe-9787-e7598bc15e06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:17.743467 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c8bc0585-ed10-40fe-9787-e7598bc15e06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:17.777696 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c8bc0585-ed10-40fe-9787-e7598bc15e06 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051186 Jun 28 03:21:17.778356 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 238/474] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:21:17 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:18.791156 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-925aa616-53a2-4d21-8b26-2f01f20301b3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:18.793297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-925aa616-53a2-4d21-8b26-2f01f20301b3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:18.801408 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-930590727", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9da7fe3f-1d18-4c0b-9bbc-ebc663cd4b3d"}], "security_groups": [{"name": "tempest-securitygroup--1117204712"}], "key_name": "tempest-keypair-856977450", "user_data": "}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:18.802777 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-925aa616-53a2-4d21-8b26-2f01f20301b3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:18.803218 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-925aa616-53a2-4d21-8b26-2f01f20301b3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:18.803968 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-925aa616-53a2-4d21-8b26-2f01f20301b3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:18.804417 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-925aa616-53a2-4d21-8b26-2f01f20301b3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:18.836650 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-925aa616-53a2-4d21-8b26-2f01f20301b3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050147 Jun 28 03:21:18.837436 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 237/475] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:21:18 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 03:21:18.894767 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e3c59e8c-67db-415f-9867-d9229cadcbb2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:18.895252 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e3c59e8c-67db-415f-9867-d9229cadcbb2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:18.901251 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e3c59e8c-67db-415f-9867-d9229cadcbb2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:18.901676 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e3c59e8c-67db-415f-9867-d9229cadcbb2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:18.902419 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e3c59e8c-67db-415f-9867-d9229cadcbb2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:18.902837 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e3c59e8c-67db-415f-9867-d9229cadcbb2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:18.909287 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.network.neutron [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] validate_networks() for [('9da7fe3f-1d18-4c0b-9bbc-ebc663cd4b3d', None, None, None, None, None)] {{(pid=117681) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:21:18.927896 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e3c59e8c-67db-415f-9867-d9229cadcbb2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:21:19.007928 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e3c59e8c-67db-415f-9867-d9229cadcbb2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 204 len: 0 microversion: 2.1 time: 0.116729 Jun 28 03:21:19.011827 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 238/476] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:21:18 2022] DELETE /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 28 03:21:19.017960 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0d894bec-7fbc-4445-a318-1dcf57c16412 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:19.018671 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0d894bec-7fbc-4445-a318-1dcf57c16412 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:19.025016 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d894bec-7fbc-4445-a318-1dcf57c16412 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:19.025459 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d894bec-7fbc-4445-a318-1dcf57c16412 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:19.026225 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d894bec-7fbc-4445-a318-1dcf57c16412 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:19.026653 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d894bec-7fbc-4445-a318-1dcf57c16412 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:19.241716 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0d894bec-7fbc-4445-a318-1dcf57c16412 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:19.249626 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0d894bec-7fbc-4445-a318-1dcf57c16412 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1680 microversion: 2.1 time: 0.236203 Jun 28 03:21:19.250300 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 239/477] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:19 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:21:19.349787 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Flavor limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:21:19.350447 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Image limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:21:19.351131 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Flavor pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:21:19.351760 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Image pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:21:19.352351 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:21:19.364311 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:19.364754 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:19.365541 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:19.365973 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:19.372760 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=100 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:19.384035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Getting quotas for project c1e596746cc64a1981804d95f1906bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:21:19.388136 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Getting quotas for user facb00bcd5644550a93901791f77b89c and project c1e596746cc64a1981804d95f1906bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:21:19.399902 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Going to run 1 instances... {{(pid=117681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:21:19.402234 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:21:19.453768 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a6c6e72e-7ebe-49bd-8b8f-44dd64a2981a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.656684 Jun 28 03:21:19.454638 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 239/478] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:21:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 28 03:21:19.465376 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e49dc30c-4e8d-48a9-8211-9207cbe5227d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:19.465981 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e49dc30c-4e8d-48a9-8211-9207cbe5227d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:19.524675 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e49dc30c-4e8d-48a9-8211-9207cbe5227d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:19.531913 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e49dc30c-4e8d-48a9-8211-9207cbe5227d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1244 microversion: 2.1 time: 0.069903 Jun 28 03:21:19.532871 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 240/479] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:19 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1244 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:20.272395 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-97c88b6d-100b-4166-94c0-31c167e42400 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:20.273449 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-97c88b6d-100b-4166-94c0-31c167e42400 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:20.283791 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-97c88b6d-100b-4166-94c0-31c167e42400 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:20.284268 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-97c88b6d-100b-4166-94c0-31c167e42400 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:20.285020 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-97c88b6d-100b-4166-94c0-31c167e42400 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:20.285446 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-97c88b6d-100b-4166-94c0-31c167e42400 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:20.431642 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-97c88b6d-100b-4166-94c0-31c167e42400 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:20.439537 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-97c88b6d-100b-4166-94c0-31c167e42400 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1680 microversion: 2.1 time: 0.174805 Jun 28 03:21:20.440096 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 240/480] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:20 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:20.551732 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-aa3890f9-75c2-4e5c-93dc-b74e29eb045e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:20.552630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-aa3890f9-75c2-4e5c-93dc-b74e29eb045e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:20.562033 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aa3890f9-75c2-4e5c-93dc-b74e29eb045e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:20.562909 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aa3890f9-75c2-4e5c-93dc-b74e29eb045e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:20.563669 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aa3890f9-75c2-4e5c-93dc-b74e29eb045e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:20.564086 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aa3890f9-75c2-4e5c-93dc-b74e29eb045e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:20.626747 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-aa3890f9-75c2-4e5c-93dc-b74e29eb045e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:20.638263 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-aa3890f9-75c2-4e5c-93dc-b74e29eb045e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1248 microversion: 2.1 time: 0.092536 Jun 28 03:21:20.639194 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 241/481] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:20 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1248 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:21.457241 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-99ecb48b-01b5-44ae-a18c-234c4729a3d8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:21.457887 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-99ecb48b-01b5-44ae-a18c-234c4729a3d8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:21.465416 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-99ecb48b-01b5-44ae-a18c-234c4729a3d8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:21.466123 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-99ecb48b-01b5-44ae-a18c-234c4729a3d8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:21.467111 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-99ecb48b-01b5-44ae-a18c-234c4729a3d8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:21.467772 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-99ecb48b-01b5-44ae-a18c-234c4729a3d8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:21.655386 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ce63b478-220f-404f-97bd-cd83c04fbd72 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:21.656017 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ce63b478-220f-404f-97bd-cd83c04fbd72 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:21.660888 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-99ecb48b-01b5-44ae-a18c-234c4729a3d8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:21.666075 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:21.670891 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-99ecb48b-01b5-44ae-a18c-234c4729a3d8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 200 len: 1680 microversion: 2.1 time: 0.217872 Jun 28 03:21:21.674412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 241/482] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:21 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:21.685659 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce63b478-220f-404f-97bd-cd83c04fbd72 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:21.686107 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce63b478-220f-404f-97bd-cd83c04fbd72 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:21.687140 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce63b478-220f-404f-97bd-cd83c04fbd72 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:21.687643 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce63b478-220f-404f-97bd-cd83c04fbd72 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:21.802186 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ce63b478-220f-404f-97bd-cd83c04fbd72 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:21.809697 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ce63b478-220f-404f-97bd-cd83c04fbd72 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1302 microversion: 2.1 time: 0.158642 Jun 28 03:21:21.810269 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 242/483] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:21 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1302 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:21:22.024117 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-6a713158-a150-4874-969c-c2f743fa15f6 req-93344651-e884-4c97-9ff3-62439fb7b4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e", "name": "network-vif-deleted", "tag": "d6e55600-5f0a-4fbe-a2ac-19740c81c992"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:22.032276 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-6a713158-a150-4874-969c-c2f743fa15f6 req-93344651-e884-4c97-9ff3-62439fb7b4bf service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:22.032734 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-6a713158-a150-4874-969c-c2f743fa15f6 req-93344651-e884-4c97-9ff3-62439fb7b4bf service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:22.044962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-6a713158-a150-4874-969c-c2f743fa15f6 req-93344651-e884-4c97-9ff3-62439fb7b4bf service nova] Creating event network-vif-deleted:d6e55600-5f0a-4fbe-a2ac-19740c81c992 for instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e on hv-cinder-84684 Jun 28 03:21:22.050793 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-6a713158-a150-4874-969c-c2f743fa15f6 req-93344651-e884-4c97-9ff3-62439fb7b4bf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030492 Jun 28 03:21:22.051627 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 242/484] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:22.698773 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e82f1010-e2a4-468e-ac79-99d624d5988c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:22.700878 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e82f1010-e2a4-468e-ac79-99d624d5988c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:22.713696 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e82f1010-e2a4-468e-ac79-99d624d5988c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:22.714571 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e82f1010-e2a4-468e-ac79-99d624d5988c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:22.715836 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e82f1010-e2a4-468e-ac79-99d624d5988c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:22.716268 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e82f1010-e2a4-468e-ac79-99d624d5988c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:22.733230 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-e82f1010-e2a4-468e-ac79-99d624d5988c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e82f1010-e2a4-468e-ac79-99d624d5988c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e HTTP/1.1 Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:21:22.735079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:21:22.736427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:21:22.736427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:21:22.736427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:21:22.736427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:21:22.736427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:21:22.736427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:21:22.736427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:21:22.736427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:21:22.736427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:21:22.736427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:21:22.736427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:21:22.736427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': 'c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e'} Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:21:22.737151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:21:22.738310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:21:22.742028 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e82f1010-e2a4-468e-ac79-99d624d5988c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 404 to user: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:21:22.742028 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e82f1010-e2a4-468e-ac79-99d624d5988c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 404 len: 111 microversion: 2.1 time: 0.049674 Jun 28 03:21:22.742028 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 243/485] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:22 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:21:22.755846 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-1baf0ad6-930b-49f0-8d5f-7a03f4320753 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '.version_select at 0x7f53f1e08a60>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:22.782820 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-1baf0ad6-930b-49f0-8d5f-7a03f4320753 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-237055435" status: 202 len: 0 microversion: 2.1 time: 0.039109 Jun 28 03:21:22.783925 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 243/486] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jun 28 03:21:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-237055435 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:21:22.827521 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7f0cee1b-2cce-42c6-949a-6f48619e94e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:22.828246 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7f0cee1b-2cce-42c6-949a-6f48619e94e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:22.834810 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7f0cee1b-2cce-42c6-949a-6f48619e94e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:22.835925 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7f0cee1b-2cce-42c6-949a-6f48619e94e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:22.836929 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7f0cee1b-2cce-42c6-949a-6f48619e94e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:22.837590 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7f0cee1b-2cce-42c6-949a-6f48619e94e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:23.030047 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7f0cee1b-2cce-42c6-949a-6f48619e94e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:23.038707 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7f0cee1b-2cce-42c6-949a-6f48619e94e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1370 microversion: 2.1 time: 0.215377 Jun 28 03:21:23.039692 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 244/487] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:22 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:23.395250 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-6f70f9fc-def6-4b58-8b4f-9f909327e130 req-8556dfe8-05fd-4347-814b-385b3dbed2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c49a8f-7779-4a9b-90dd-de3f851c517b", "tag": "fdbb463e-d574-49cc-aabd-b6a74106c928"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:23.412205 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-6f70f9fc-def6-4b58-8b4f-9f909327e130 req-8556dfe8-05fd-4347-814b-385b3dbed2fc service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:23.415462 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-6f70f9fc-def6-4b58-8b4f-9f909327e130 req-8556dfe8-05fd-4347-814b-385b3dbed2fc service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:23.428764 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-6f70f9fc-def6-4b58-8b4f-9f909327e130 req-8556dfe8-05fd-4347-814b-385b3dbed2fc service nova] Creating event network-changed:fdbb463e-d574-49cc-aabd-b6a74106c928 for instance 88c49a8f-7779-4a9b-90dd-de3f851c517b on hv-cinder-84684 Jun 28 03:21:23.435407 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-6f70f9fc-def6-4b58-8b4f-9f909327e130 req-8556dfe8-05fd-4347-814b-385b3dbed2fc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044872 Jun 28 03:21:23.438432 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 244/488] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:23.623919 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5a01f58a-e609-4b8d-9eef-5cc5caec7914 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Action: 'create', calling method: .version_select at 0x7f53f2580a60>, body: {"keypair": {"name": "tempest-keypair-357650152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoEx5AnmpJy7XcT7htud05uyuijxJi4u0sq1nA2aW45bEXcOqYmLOLIMF/mhoqn/Lz+2ykkLT1249azlC+m9l6huuU7xDpRTQB0zAcFFuXM4HleCq8JOakTZ2qCCA2Jrg=="}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:23.638641 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-5a01f58a-e609-4b8d-9eef-5cc5caec7914 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for project 63f6b05085584fd5beecbe54c7251525. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:21:23.643373 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-5a01f58a-e609-4b8d-9eef-5cc5caec7914 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for user 4181737f6f2348d2906aea642b8598f7 and project 63f6b05085584fd5beecbe54c7251525. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:21:23.669518 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5a01f58a-e609-4b8d-9eef-5cc5caec7914 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049281 Jun 28 03:21:23.670379 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 245/489] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 28 03:21:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:24.056326 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-23c6001c-05a3-4902-86e5-0b626fa87ed0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:24.056876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-23c6001c-05a3-4902-86e5-0b626fa87ed0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:24.063594 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-23c6001c-05a3-4902-86e5-0b626fa87ed0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:24.064049 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-23c6001c-05a3-4902-86e5-0b626fa87ed0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:24.064831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-23c6001c-05a3-4902-86e5-0b626fa87ed0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:24.065287 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-23c6001c-05a3-4902-86e5-0b626fa87ed0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:24.201566 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-23c6001c-05a3-4902-86e5-0b626fa87ed0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:24.209904 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-23c6001c-05a3-4902-86e5-0b626fa87ed0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1370 microversion: 2.1 time: 0.158557 Jun 28 03:21:24.210477 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 245/490] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:24 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:25.226926 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a1d52b43-b917-4678-923e-598c5196b2b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:25.227559 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a1d52b43-b917-4678-923e-598c5196b2b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:25.234664 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a1d52b43-b917-4678-923e-598c5196b2b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:25.235476 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a1d52b43-b917-4678-923e-598c5196b2b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:25.236588 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a1d52b43-b917-4678-923e-598c5196b2b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:25.237249 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a1d52b43-b917-4678-923e-598c5196b2b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:25.317222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1642668364", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78d460e7-819f-442d-8ddd-fecab5b4b6fc"}], "security_groups": [{"name": "tempest-securitygroup--1986045428"}], "key_name": "tempest-keypair-357650152", "user_data": "}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:25.379454 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a1d52b43-b917-4678-923e-598c5196b2b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:25.387977 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a1d52b43-b917-4678-923e-598c5196b2b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1370 microversion: 2.1 time: 0.164971 Jun 28 03:21:25.389139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 246/491] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:25 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:25.427689 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.network.neutron [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] validate_networks() for [('78d460e7-819f-442d-8ddd-fecab5b4b6fc', None, None, None, None, None)] {{(pid=117681) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:21:25.605757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:25.802101 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Flavor limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:21:25.802522 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Image limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:21:25.802996 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Flavor pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:21:25.803395 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Image pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:21:25.803797 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:21:25.814956 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:25.815399 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:25.816187 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:25.816650 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:25.833757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for project 63f6b05085584fd5beecbe54c7251525. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:21:25.838021 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for user 4181737f6f2348d2906aea642b8598f7 and project 63f6b05085584fd5beecbe54c7251525. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:21:25.849813 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Going to run 1 instances... {{(pid=117681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:21:25.852004 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:21:25.905103 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-8ac2a8cd-a741-4164-9aec-9f51bfe278d6 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.591966 Jun 28 03:21:25.906201 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 246/492] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:21:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 28 03:21:25.922880 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-067495d3-f225-4cb8-95f0-8f6093d04cd9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:25.923911 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-067495d3-f225-4cb8-95f0-8f6093d04cd9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:25.978635 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-067495d3-f225-4cb8-95f0-8f6093d04cd9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:25.986639 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-067495d3-f225-4cb8-95f0-8f6093d04cd9 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 200 len: 1241 microversion: 2.1 time: 0.070910 Jun 28 03:21:25.993347 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 247/493] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:25 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:21:26.405412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d20d2600-bdab-48f3-948e-c55c7b5f17bf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:26.406235 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d20d2600-bdab-48f3-948e-c55c7b5f17bf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:26.413053 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d20d2600-bdab-48f3-948e-c55c7b5f17bf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:26.413488 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d20d2600-bdab-48f3-948e-c55c7b5f17bf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:26.414240 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d20d2600-bdab-48f3-948e-c55c7b5f17bf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:26.414669 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d20d2600-bdab-48f3-948e-c55c7b5f17bf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:26.556461 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d20d2600-bdab-48f3-948e-c55c7b5f17bf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:26.565030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d20d2600-bdab-48f3-948e-c55c7b5f17bf tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1370 microversion: 2.1 time: 0.163543 Jun 28 03:21:26.569028 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 247/494] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:26 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:27.003761 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-02b54e72-5222-41b1-9449-448acbad32e1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:27.004634 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-02b54e72-5222-41b1-9449-448acbad32e1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:27.010720 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02b54e72-5222-41b1-9449-448acbad32e1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:27.011165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02b54e72-5222-41b1-9449-448acbad32e1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:27.011916 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02b54e72-5222-41b1-9449-448acbad32e1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:27.012368 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02b54e72-5222-41b1-9449-448acbad32e1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:27.076867 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-02b54e72-5222-41b1-9449-448acbad32e1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:27.079261 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:27.086152 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-02b54e72-5222-41b1-9449-448acbad32e1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 200 len: 1301 microversion: 2.1 time: 0.086341 Jun 28 03:21:27.087038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 248/495] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:26 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:27.581721 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b4d09f97-429e-43e0-8fc2-b38da939b80a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:27.582410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b4d09f97-429e-43e0-8fc2-b38da939b80a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:27.589754 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b4d09f97-429e-43e0-8fc2-b38da939b80a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:27.590195 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b4d09f97-429e-43e0-8fc2-b38da939b80a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:27.590986 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b4d09f97-429e-43e0-8fc2-b38da939b80a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:27.591411 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b4d09f97-429e-43e0-8fc2-b38da939b80a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:27.721943 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b4d09f97-429e-43e0-8fc2-b38da939b80a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:27.729576 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b4d09f97-429e-43e0-8fc2-b38da939b80a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1370 microversion: 2.1 time: 0.151896 Jun 28 03:21:27.730108 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 248/496] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:27 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:28.104694 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-216493a8-1373-4dc3-b4b7-9c7d0c02d7f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:28.106344 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-216493a8-1373-4dc3-b4b7-9c7d0c02d7f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:28.115290 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-216493a8-1373-4dc3-b4b7-9c7d0c02d7f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:28.115997 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-216493a8-1373-4dc3-b4b7-9c7d0c02d7f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:28.116977 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-216493a8-1373-4dc3-b4b7-9c7d0c02d7f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:28.117411 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-216493a8-1373-4dc3-b4b7-9c7d0c02d7f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:28.254743 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-216493a8-1373-4dc3-b4b7-9c7d0c02d7f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:28.263026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-216493a8-1373-4dc3-b4b7-9c7d0c02d7f5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 200 len: 1367 microversion: 2.1 time: 0.163361 Jun 28 03:21:28.263607 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 249/497] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:28 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:28.612981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-e35f89e6-c4e9-4020-9148-038dffd8e0be req-f367bfe2-dc0c-4da5-98ed-aca2c3090237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da", "tag": "7bac8765-f69c-4d0f-8f64-222af3fb6108"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:28.623741 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-e35f89e6-c4e9-4020-9148-038dffd8e0be req-f367bfe2-dc0c-4da5-98ed-aca2c3090237 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:28.624271 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-e35f89e6-c4e9-4020-9148-038dffd8e0be req-f367bfe2-dc0c-4da5-98ed-aca2c3090237 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:28.636431 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-e35f89e6-c4e9-4020-9148-038dffd8e0be req-f367bfe2-dc0c-4da5-98ed-aca2c3090237 service nova] Creating event network-changed:7bac8765-f69c-4d0f-8f64-222af3fb6108 for instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da on hv-cinder-84684 Jun 28 03:21:28.641114 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-e35f89e6-c4e9-4020-9148-038dffd8e0be req-f367bfe2-dc0c-4da5-98ed-aca2c3090237 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031959 Jun 28 03:21:28.641799 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 249/498] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:28.747030 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-05be913d-b306-4ae7-ac91-32c56deef2ed tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:28.747637 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-05be913d-b306-4ae7-ac91-32c56deef2ed tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:28.755209 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-05be913d-b306-4ae7-ac91-32c56deef2ed tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:28.755859 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-05be913d-b306-4ae7-ac91-32c56deef2ed tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:28.756722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-05be913d-b306-4ae7-ac91-32c56deef2ed tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:28.757144 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-05be913d-b306-4ae7-ac91-32c56deef2ed tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:28.892442 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-05be913d-b306-4ae7-ac91-32c56deef2ed tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:28.900197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-05be913d-b306-4ae7-ac91-32c56deef2ed tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1370 microversion: 2.1 time: 0.156981 Jun 28 03:21:28.900822 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 250/499] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:28 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:29.280873 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-0950fbcf-2493-4f01-b334-8e2e9320fb8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:29.282051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-0950fbcf-2493-4f01-b334-8e2e9320fb8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:29.288237 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0950fbcf-2493-4f01-b334-8e2e9320fb8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:29.288681 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0950fbcf-2493-4f01-b334-8e2e9320fb8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:29.289435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0950fbcf-2493-4f01-b334-8e2e9320fb8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:29.289862 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0950fbcf-2493-4f01-b334-8e2e9320fb8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:29.327560 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-5375fb03-ae33-4348-9d13-9eba5e129cad req-e667aa04-55be-43a2-8b12-25541894a574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c49a8f-7779-4a9b-90dd-de3f851c517b", "name": "network-vif-plugged", "status": "completed", "tag": "fdbb463e-d574-49cc-aabd-b6a74106c928"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:29.339899 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-5375fb03-ae33-4348-9d13-9eba5e129cad req-e667aa04-55be-43a2-8b12-25541894a574 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:29.340669 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-5375fb03-ae33-4348-9d13-9eba5e129cad req-e667aa04-55be-43a2-8b12-25541894a574 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:29.357193 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-5375fb03-ae33-4348-9d13-9eba5e129cad req-e667aa04-55be-43a2-8b12-25541894a574 service nova] Creating event network-vif-plugged:fdbb463e-d574-49cc-aabd-b6a74106c928 for instance 88c49a8f-7779-4a9b-90dd-de3f851c517b on hv-cinder-84684 Jun 28 03:21:29.364647 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-5375fb03-ae33-4348-9d13-9eba5e129cad req-e667aa04-55be-43a2-8b12-25541894a574 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041361 Jun 28 03:21:29.365512 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 251/500] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:21:29.435441 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-0950fbcf-2493-4f01-b334-8e2e9320fb8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:29.443090 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-0950fbcf-2493-4f01-b334-8e2e9320fb8a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 200 len: 1367 microversion: 2.1 time: 0.166531 Jun 28 03:21:29.443643 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 250/501] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:29 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:29.918177 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f5f6a948-cdce-4057-b3b0-a3db172a3fd8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:29.918893 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f5f6a948-cdce-4057-b3b0-a3db172a3fd8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:29.926091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f5f6a948-cdce-4057-b3b0-a3db172a3fd8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:29.926535 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f5f6a948-cdce-4057-b3b0-a3db172a3fd8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:29.927300 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f5f6a948-cdce-4057-b3b0-a3db172a3fd8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:29.927724 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f5f6a948-cdce-4057-b3b0-a3db172a3fd8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:30.090461 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f5f6a948-cdce-4057-b3b0-a3db172a3fd8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:30.098832 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f5f6a948-cdce-4057-b3b0-a3db172a3fd8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1370 microversion: 2.1 time: 0.184670 Jun 28 03:21:30.099330 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 252/502] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:29 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:30.460690 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-fe9b1d98-df15-424d-8f96-d336028e2945 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:30.462165 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-fe9b1d98-df15-424d-8f96-d336028e2945 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:30.469455 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fe9b1d98-df15-424d-8f96-d336028e2945 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:30.469919 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fe9b1d98-df15-424d-8f96-d336028e2945 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:30.471105 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fe9b1d98-df15-424d-8f96-d336028e2945 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:30.471105 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fe9b1d98-df15-424d-8f96-d336028e2945 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:30.624324 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-fe9b1d98-df15-424d-8f96-d336028e2945 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:30.632180 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-fe9b1d98-df15-424d-8f96-d336028e2945 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 200 len: 1367 microversion: 2.1 time: 0.175416 Jun 28 03:21:30.632770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 251/503] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:30 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:31.120242 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4c456493-206d-4ba0-96a0-8864529c8c45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:31.120795 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4c456493-206d-4ba0-96a0-8864529c8c45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:31.127615 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4c456493-206d-4ba0-96a0-8864529c8c45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:31.128059 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4c456493-206d-4ba0-96a0-8864529c8c45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:31.128849 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4c456493-206d-4ba0-96a0-8864529c8c45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:31.129332 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4c456493-206d-4ba0-96a0-8864529c8c45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:31.272370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4c456493-206d-4ba0-96a0-8864529c8c45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:31.279991 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4c456493-206d-4ba0-96a0-8864529c8c45 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1370 microversion: 2.1 time: 0.163681 Jun 28 03:21:31.280558 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 253/504] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:31 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:31.651910 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-0202c3e9-3030-4bfb-8b7a-ff1c4d5ee681 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:31.652768 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-0202c3e9-3030-4bfb-8b7a-ff1c4d5ee681 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:31.661235 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0202c3e9-3030-4bfb-8b7a-ff1c4d5ee681 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:31.661685 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0202c3e9-3030-4bfb-8b7a-ff1c4d5ee681 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:31.663061 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0202c3e9-3030-4bfb-8b7a-ff1c4d5ee681 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:31.663546 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0202c3e9-3030-4bfb-8b7a-ff1c4d5ee681 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:31.798969 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-0202c3e9-3030-4bfb-8b7a-ff1c4d5ee681 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:31.806764 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-0202c3e9-3030-4bfb-8b7a-ff1c4d5ee681 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 200 len: 1367 microversion: 2.1 time: 0.160316 Jun 28 03:21:31.807324 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 252/505] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:31 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:32.302079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d037715e-37ef-4d0d-87f3-a3934ba5fb90 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:32.302925 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d037715e-37ef-4d0d-87f3-a3934ba5fb90 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:32.313191 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d037715e-37ef-4d0d-87f3-a3934ba5fb90 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:32.313628 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d037715e-37ef-4d0d-87f3-a3934ba5fb90 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:32.314379 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d037715e-37ef-4d0d-87f3-a3934ba5fb90 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:32.314806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d037715e-37ef-4d0d-87f3-a3934ba5fb90 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:32.450591 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d037715e-37ef-4d0d-87f3-a3934ba5fb90 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:32.458639 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d037715e-37ef-4d0d-87f3-a3934ba5fb90 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1370 microversion: 2.1 time: 0.163509 Jun 28 03:21:32.459175 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 254/506] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:32 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:32.828177 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-0ecdac6e-b1b4-4f20-91bc-ed9ab1597deb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:32.828905 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-0ecdac6e-b1b4-4f20-91bc-ed9ab1597deb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:32.835786 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0ecdac6e-b1b4-4f20-91bc-ed9ab1597deb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:32.836233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0ecdac6e-b1b4-4f20-91bc-ed9ab1597deb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:32.837011 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0ecdac6e-b1b4-4f20-91bc-ed9ab1597deb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:32.837430 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0ecdac6e-b1b4-4f20-91bc-ed9ab1597deb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:32.968198 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-0ecdac6e-b1b4-4f20-91bc-ed9ab1597deb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:32.977915 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-0ecdac6e-b1b4-4f20-91bc-ed9ab1597deb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 200 len: 1367 microversion: 2.1 time: 0.155931 Jun 28 03:21:32.978674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 253/507] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:32 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:33.348453 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-095912ee-7a4e-410f-aede-84bf293ff9f0 req-5a1751ce-ff4e-43f0-848f-cfe6f2aad35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da", "name": "network-vif-plugged", "status": "completed", "tag": "7bac8765-f69c-4d0f-8f64-222af3fb6108"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:33.358536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-095912ee-7a4e-410f-aede-84bf293ff9f0 req-5a1751ce-ff4e-43f0-848f-cfe6f2aad35c service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:33.359321 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-095912ee-7a4e-410f-aede-84bf293ff9f0 req-5a1751ce-ff4e-43f0-848f-cfe6f2aad35c service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:33.372454 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-095912ee-7a4e-410f-aede-84bf293ff9f0 req-5a1751ce-ff4e-43f0-848f-cfe6f2aad35c service nova] Creating event network-vif-plugged:7bac8765-f69c-4d0f-8f64-222af3fb6108 for instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da on hv-cinder-84684 Jun 28 03:21:33.377486 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-095912ee-7a4e-410f-aede-84bf293ff9f0 req-5a1751ce-ff4e-43f0-848f-cfe6f2aad35c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032906 Jun 28 03:21:33.378231 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 255/508] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:33.475453 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2da6b15b-94df-4d05-9240-779d9949bff1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:33.475996 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2da6b15b-94df-4d05-9240-779d9949bff1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:33.482968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2da6b15b-94df-4d05-9240-779d9949bff1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:33.483411 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2da6b15b-94df-4d05-9240-779d9949bff1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:33.484412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2da6b15b-94df-4d05-9240-779d9949bff1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:33.484892 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2da6b15b-94df-4d05-9240-779d9949bff1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:33.624774 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2da6b15b-94df-4d05-9240-779d9949bff1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:33.632624 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2da6b15b-94df-4d05-9240-779d9949bff1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1564 microversion: 2.1 time: 0.161241 Jun 28 03:21:33.633154 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 254/509] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:33 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:33.649921 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5844f4cd-05f8-415c-85bc-6989ba4c99d5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:33.650487 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5844f4cd-05f8-415c-85bc-6989ba4c99d5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:33.657189 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5844f4cd-05f8-415c-85bc-6989ba4c99d5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:33.657625 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5844f4cd-05f8-415c-85bc-6989ba4c99d5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:33.658356 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5844f4cd-05f8-415c-85bc-6989ba4c99d5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:33.658792 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5844f4cd-05f8-415c-85bc-6989ba4c99d5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:33.734545 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5844f4cd-05f8-415c-85bc-6989ba4c99d5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088670 Jun 28 03:21:33.735143 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 256/510] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 28 03:21:33 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:33.995185 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7370a09e-9944-4f45-a979-4e60273abeb7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:33.995741 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7370a09e-9944-4f45-a979-4e60273abeb7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:34.002707 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7370a09e-9944-4f45-a979-4e60273abeb7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:34.003152 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7370a09e-9944-4f45-a979-4e60273abeb7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:34.004182 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7370a09e-9944-4f45-a979-4e60273abeb7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:34.004614 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7370a09e-9944-4f45-a979-4e60273abeb7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:34.137841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7370a09e-9944-4f45-a979-4e60273abeb7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:34.145730 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7370a09e-9944-4f45-a979-4e60273abeb7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 200 len: 1367 microversion: 2.1 time: 0.154606 Jun 28 03:21:34.146391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 255/511] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:33 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:34.882986 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-cc7155c2-787d-40e8-8ca4-83313596ccca req-58ef3e6b-2080-4536-8f0b-2f8fc1d86c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c49a8f-7779-4a9b-90dd-de3f851c517b", "tag": "fdbb463e-d574-49cc-aabd-b6a74106c928"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:34.891503 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-cc7155c2-787d-40e8-8ca4-83313596ccca req-58ef3e6b-2080-4536-8f0b-2f8fc1d86c97 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:34.892069 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-cc7155c2-787d-40e8-8ca4-83313596ccca req-58ef3e6b-2080-4536-8f0b-2f8fc1d86c97 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:34.903357 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-cc7155c2-787d-40e8-8ca4-83313596ccca req-58ef3e6b-2080-4536-8f0b-2f8fc1d86c97 service nova] Creating event network-changed:fdbb463e-d574-49cc-aabd-b6a74106c928 for instance 88c49a8f-7779-4a9b-90dd-de3f851c517b on hv-cinder-84684 Jun 28 03:21:34.908616 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-cc7155c2-787d-40e8-8ca4-83313596ccca req-58ef3e6b-2080-4536-8f0b-2f8fc1d86c97 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029218 Jun 28 03:21:34.909316 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 257/512] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:35.163402 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9ddc1c52-bdcf-4bc3-954b-4a4807e67f0e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:35.164035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-9ddc1c52-bdcf-4bc3-954b-4a4807e67f0e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:35.171037 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9ddc1c52-bdcf-4bc3-954b-4a4807e67f0e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:35.171706 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9ddc1c52-bdcf-4bc3-954b-4a4807e67f0e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:35.172708 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9ddc1c52-bdcf-4bc3-954b-4a4807e67f0e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:35.173132 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9ddc1c52-bdcf-4bc3-954b-4a4807e67f0e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:35.329262 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9ddc1c52-bdcf-4bc3-954b-4a4807e67f0e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:35.337029 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-9ddc1c52-bdcf-4bc3-954b-4a4807e67f0e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 200 len: 1367 microversion: 2.1 time: 0.177968 Jun 28 03:21:35.337638 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 256/513] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:35 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:36.352136 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=8 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:36.357935 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-02533411-800e-4c9c-b618-46695c32c2d7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:36.358635 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-02533411-800e-4c9c-b618-46695c32c2d7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:36.365809 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02533411-800e-4c9c-b618-46695c32c2d7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:36.366278 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02533411-800e-4c9c-b618-46695c32c2d7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:36.367035 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02533411-800e-4c9c-b618-46695c32c2d7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:36.367461 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02533411-800e-4c9c-b618-46695c32c2d7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:36.503069 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-02533411-800e-4c9c-b618-46695c32c2d7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:36.515153 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-02533411-800e-4c9c-b618-46695c32c2d7 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 200 len: 1556 microversion: 2.1 time: 0.163822 Jun 28 03:21:36.516369 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 258/514] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:21:36 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:36.540105 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-33723342-96e5-4f50-8f4a-b04f4be67c61 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:36.540984 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-33723342-96e5-4f50-8f4a-b04f4be67c61 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:36.543709 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=4 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:36.544469 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=16 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:36.551527 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-33723342-96e5-4f50-8f4a-b04f4be67c61 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:36.551944 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-33723342-96e5-4f50-8f4a-b04f4be67c61 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:36.552719 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-33723342-96e5-4f50-8f4a-b04f4be67c61 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:36.553145 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-33723342-96e5-4f50-8f4a-b04f4be67c61 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:36.641950 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-33723342-96e5-4f50-8f4a-b04f4be67c61 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107736 Jun 28 03:21:36.642799 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 257/515] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 28 03:21:36 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:37.869582 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-ed66d8b3-8563-4533-828d-5f1355e1cb83 req-3cb84c09-7a72-4304-84b7-0280e846facd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da", "tag": "7bac8765-f69c-4d0f-8f64-222af3fb6108"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:37.877894 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-ed66d8b3-8563-4533-828d-5f1355e1cb83 req-3cb84c09-7a72-4304-84b7-0280e846facd service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:37.878321 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-ed66d8b3-8563-4533-828d-5f1355e1cb83 req-3cb84c09-7a72-4304-84b7-0280e846facd service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:37.889563 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-ed66d8b3-8563-4533-828d-5f1355e1cb83 req-3cb84c09-7a72-4304-84b7-0280e846facd service nova] Creating event network-changed:7bac8765-f69c-4d0f-8f64-222af3fb6108 for instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da on hv-cinder-84684 Jun 28 03:21:37.894911 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-ed66d8b3-8563-4533-828d-5f1355e1cb83 req-3cb84c09-7a72-4304-84b7-0280e846facd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029068 Jun 28 03:21:37.895487 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 259/516] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:41.832168 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7f40f5fd-6dd5-4ea3-aa35-33a972e85b76 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:41.832786 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7f40f5fd-6dd5-4ea3-aa35-33a972e85b76 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:41.839770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7f40f5fd-6dd5-4ea3-aa35-33a972e85b76 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:41.840222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7f40f5fd-6dd5-4ea3-aa35-33a972e85b76 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:41.841005 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7f40f5fd-6dd5-4ea3-aa35-33a972e85b76 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:41.841432 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7f40f5fd-6dd5-4ea3-aa35-33a972e85b76 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:41.873454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7f40f5fd-6dd5-4ea3-aa35-33a972e85b76 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-volume_attachments/de1ae3d9-9248-4955-89cf-ce98e1943c09" status: 200 len: 194 microversion: 2.20 time: 0.047650 Jun 28 03:21:41.874030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 258/517] 10.222.0.44 () {60 vars in 1453 bytes} [Tue Jun 28 03:21:41 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-volume_attachments/de1ae3d9-9248-4955-89cf-ce98e1943c09 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:21:41.938969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-baae5364-d835-4c6d-bdb0-3445c32201d6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:41.939585 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-baae5364-d835-4c6d-bdb0-3445c32201d6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:41.946430 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-baae5364-d835-4c6d-bdb0-3445c32201d6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:41.946873 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-baae5364-d835-4c6d-bdb0-3445c32201d6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:41.947622 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-baae5364-d835-4c6d-bdb0-3445c32201d6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:41.948052 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-baae5364-d835-4c6d-bdb0-3445c32201d6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:42.031713 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-baae5364-d835-4c6d-bdb0-3445c32201d6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lazy-loading 'services' on Instance uuid 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:21:42.118092 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-baae5364-d835-4c6d-bdb0-3445c32201d6 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "DELETE /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-volume_attachments/de1ae3d9-9248-4955-89cf-ce98e1943c09" status: 202 len: 0 microversion: 2.20 time: 0.183545 Jun 28 03:21:42.118763 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 260/518] 10.222.0.44 () {60 vars in 1456 bytes} [Tue Jun 28 03:21:41 2022] DELETE /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-volume_attachments/de1ae3d9-9248-4955-89cf-ce98e1943c09 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:21:42.128334 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-1068328b-6c38-4115-9b03-7f5ae3879f54 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:42.129246 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-1068328b-6c38-4115-9b03-7f5ae3879f54 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:42.136478 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1068328b-6c38-4115-9b03-7f5ae3879f54 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:42.136916 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1068328b-6c38-4115-9b03-7f5ae3879f54 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:42.137815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1068328b-6c38-4115-9b03-7f5ae3879f54 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:42.138242 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1068328b-6c38-4115-9b03-7f5ae3879f54 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:42.168852 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-1068328b-6c38-4115-9b03-7f5ae3879f54 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044464 Jun 28 03:21:42.169435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 259/519] 10.222.0.44 () {60 vars in 1342 bytes} [Tue Jun 28 03:21:42 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:21:43.182060 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bf2d0651-f6b2-4196-82de-e219bd3965f2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:43.183985 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-bf2d0651-f6b2-4196-82de-e219bd3965f2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:43.191195 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bf2d0651-f6b2-4196-82de-e219bd3965f2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:43.191766 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bf2d0651-f6b2-4196-82de-e219bd3965f2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:43.192576 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bf2d0651-f6b2-4196-82de-e219bd3965f2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:43.193013 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bf2d0651-f6b2-4196-82de-e219bd3965f2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:43.224010 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-bf2d0651-f6b2-4196-82de-e219bd3965f2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046272 Jun 28 03:21:43.228204 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 261/520] 10.222.0.44 () {60 vars in 1342 bytes} [Tue Jun 28 03:21:43 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:21:44.239788 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-89ad2764-2cc6-46b4-bb7c-8899e9587908 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:44.241353 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-89ad2764-2cc6-46b4-bb7c-8899e9587908 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:44.252520 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-89ad2764-2cc6-46b4-bb7c-8899e9587908 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:44.252956 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-89ad2764-2cc6-46b4-bb7c-8899e9587908 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:44.253709 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-89ad2764-2cc6-46b4-bb7c-8899e9587908 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:44.254135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-89ad2764-2cc6-46b4-bb7c-8899e9587908 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:44.267726 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=100 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:44.283596 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-89ad2764-2cc6-46b4-bb7c-8899e9587908 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050515 Jun 28 03:21:44.284493 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 260/521] 10.222.0.44 () {60 vars in 1342 bytes} [Tue Jun 28 03:21:44 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:21:44.353161 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-910d5536-3f6c-47e1-b9b0-a84d2b6156ad tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:44.353697 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-910d5536-3f6c-47e1-b9b0-a84d2b6156ad tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:44.361249 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-910d5536-3f6c-47e1-b9b0-a84d2b6156ad tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:44.362444 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-910d5536-3f6c-47e1-b9b0-a84d2b6156ad tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:44.363217 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-910d5536-3f6c-47e1-b9b0-a84d2b6156ad tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:44.363840 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-910d5536-3f6c-47e1-b9b0-a84d2b6156ad tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:44.393867 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-910d5536-3f6c-47e1-b9b0-a84d2b6156ad tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:21:44.479086 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-910d5536-3f6c-47e1-b9b0-a84d2b6156ad tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "DELETE /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 204 len: 0 microversion: 2.20 time: 0.129527 Jun 28 03:21:44.479778 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 262/522] 10.222.0.44 () {60 vars in 1279 bytes} [Tue Jun 28 03:21:44 2022] DELETE /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 28 03:21:44.488630 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-119c4b11-50eb-424b-af34-db60e908d083 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:44.489252 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-119c4b11-50eb-424b-af34-db60e908d083 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:44.495457 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-119c4b11-50eb-424b-af34-db60e908d083 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:44.495837 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-119c4b11-50eb-424b-af34-db60e908d083 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:44.496607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-119c4b11-50eb-424b-af34-db60e908d083 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:44.497028 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-119c4b11-50eb-424b-af34-db60e908d083 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:44.642948 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-119c4b11-50eb-424b-af34-db60e908d083 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:44.651207 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-119c4b11-50eb-424b-af34-db60e908d083 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:44.652701 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-119c4b11-50eb-424b-af34-db60e908d083 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:44.653849 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-119c4b11-50eb-424b-af34-db60e908d083 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.169370 Jun 28 03:21:44.654375 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 261/523] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:21:44 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:21:45.678605 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c16c1905-a898-4ddb-b8f8-1d8f76a49bc2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:45.679816 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c16c1905-a898-4ddb-b8f8-1d8f76a49bc2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:45.690425 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c16c1905-a898-4ddb-b8f8-1d8f76a49bc2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:45.690793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c16c1905-a898-4ddb-b8f8-1d8f76a49bc2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:45.691556 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c16c1905-a898-4ddb-b8f8-1d8f76a49bc2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:45.691981 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c16c1905-a898-4ddb-b8f8-1d8f76a49bc2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:45.850115 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c16c1905-a898-4ddb-b8f8-1d8f76a49bc2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:45.859041 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c16c1905-a898-4ddb-b8f8-1d8f76a49bc2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:45.860545 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c16c1905-a898-4ddb-b8f8-1d8f76a49bc2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:45.861702 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c16c1905-a898-4ddb-b8f8-1d8f76a49bc2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.190402 Jun 28 03:21:45.862345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 263/524] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:21:45 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:21:46.879998 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-18595f8f-1df6-4fe4-ab12-3c04d39e9422 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:46.880644 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-18595f8f-1df6-4fe4-ab12-3c04d39e9422 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:46.887568 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-18595f8f-1df6-4fe4-ab12-3c04d39e9422 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:46.888005 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-18595f8f-1df6-4fe4-ab12-3c04d39e9422 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:46.888857 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-18595f8f-1df6-4fe4-ab12-3c04d39e9422 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:46.889279 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-18595f8f-1df6-4fe4-ab12-3c04d39e9422 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:47.033910 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-18595f8f-1df6-4fe4-ab12-3c04d39e9422 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:47.042264 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-18595f8f-1df6-4fe4-ab12-3c04d39e9422 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:47.043698 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-18595f8f-1df6-4fe4-ab12-3c04d39e9422 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:47.044896 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-18595f8f-1df6-4fe4-ab12-3c04d39e9422 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 200 len: 1724 microversion: 2.20 time: 0.169050 Jun 28 03:21:47.045805 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 262/525] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:21:46 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:21:47.287107 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-255ead81-a549-4e16-9ca4-10520fb54e79 req-ef91cc37-3906-47dd-bf45-804e71eb4a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62f3fd86-9d6c-4d2e-8997-579c77adc3f0", "name": "network-vif-deleted", "tag": "9e28a86b-c03c-4271-880f-a8d72e9df423"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:47.296311 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-255ead81-a549-4e16-9ca4-10520fb54e79 req-ef91cc37-3906-47dd-bf45-804e71eb4a14 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:47.296730 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-255ead81-a549-4e16-9ca4-10520fb54e79 req-ef91cc37-3906-47dd-bf45-804e71eb4a14 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:47.308171 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-255ead81-a549-4e16-9ca4-10520fb54e79 req-ef91cc37-3906-47dd-bf45-804e71eb4a14 service nova] Creating event network-vif-deleted:9e28a86b-c03c-4271-880f-a8d72e9df423 for instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 on hv-cinder-84684 Jun 28 03:21:47.313220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-255ead81-a549-4e16-9ca4-10520fb54e79 req-ef91cc37-3906-47dd-bf45-804e71eb4a14 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029601 Jun 28 03:21:47.314045 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 264/526] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:48.064023 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-fac5e581-3392-41b7-b5f5-8a918f4d1d38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:48.064773 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-fac5e581-3392-41b7-b5f5-8a918f4d1d38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:48.072065 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fac5e581-3392-41b7-b5f5-8a918f4d1d38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:48.072533 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fac5e581-3392-41b7-b5f5-8a918f4d1d38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:48.073300 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fac5e581-3392-41b7-b5f5-8a918f4d1d38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:48.073731 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fac5e581-3392-41b7-b5f5-8a918f4d1d38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:48.088298 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-fac5e581-3392-41b7-b5f5-8a918f4d1d38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] HTTP exception thrown: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-fac5e581-3392-41b7-b5f5-8a918f4d1d38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Request method failure captured: Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 HTTP/1.1 Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLfqfVekJS5QVqlpWPnizndbu__ZBW53gNh0Y4alUFgbCvoYRhPbitQMxllc39OV1xmWLb4xvtZJmj1i6_NiJJP5dVTYX7s-upmgiWiht2pPcKIQ4gIZEFUu_lhFHWuWqcGOCSf6fXS4zxLraTg2tVzkOha6QxezjvHnXBSibYJNEU Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 9e47b6f7a96c46dfa9906912efb7f265 Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:21:48.090347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:21:48.091856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9e47b6f7a96c46dfa9906912efb7f265", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:21:48.091856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:21:48.091856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 9e47b6f7a96c46dfa9906912efb7f265 Jun 28 03:21:48.091856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:21:48.091856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-AttachVolumeShelveTestJSON-1525698805-project Jun 28 03:21:48.091856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:21:48.091856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:21:48.091856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 1f5f5b39c16f4cb38c12c33252786cc5 Jun 28 03:21:48.091856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1525698805-project Jun 28 03:21:48.091856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:21:48.091856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:21:48.091856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '62f3fd86-9d6c-4d2e-8997-579c77adc3f0'} Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:21:48.092970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:21:48.094170 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:21:48.096509 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-fac5e581-3392-41b7-b5f5-8a918f4d1d38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Returning 404 to user: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:21:48.097759 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-fac5e581-3392-41b7-b5f5-8a918f4d1d38 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 404 len: 111 microversion: 2.20 time: 0.038664 Jun 28 03:21:48.098331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 263/527] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:21:48 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 03:21:48.107704 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-90475369-9381-4b4c-9001-aa09863e2443 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '.version_select at 0x7f53f2710dc0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:48.128000 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-90475369-9381-4b4c-9001-aa09863e2443 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-728925176" status: 204 len: 0 microversion: 2.20 time: 0.024683 Jun 28 03:21:48.128695 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 265/528] 10.222.0.44 () {60 vars in 1258 bytes} [Tue Jun 28 03:21:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-728925176 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 28 03:21:48.774017 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-45b78ded-95c3-43d4-aaac-80470cb50553 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Action: 'create', calling method: .version_select at 0x7f53f1c5bd30>, body: {"keypair": {"name": "tempest-keypair-436932162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7yiJb3BHaL+VTa2Y+eluXtxFeklU8f5nCB/1IaHcA+hMfrSiKIzUw41936nrTxxCBPs71JJO6SYfNxFiK593YqzGDJXEYhDac9bBKyinjA04inEZgiS6I3Fh2H19v6IA=="}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:48.788347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-45b78ded-95c3-43d4-aaac-80470cb50553 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Getting quotas for project 9e47b6f7a96c46dfa9906912efb7f265. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:21:48.792372 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-45b78ded-95c3-43d4-aaac-80470cb50553 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Getting quotas for user 1f5f5b39c16f4cb38c12c33252786cc5 and project 9e47b6f7a96c46dfa9906912efb7f265. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:21:48.816078 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-45b78ded-95c3-43d4-aaac-80470cb50553 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045851 Jun 28 03:21:48.816700 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 264/529] 10.222.0.44 () {62 vars in 1199 bytes} [Tue Jun 28 03:21:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 28 03:21:50.121302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1999785503", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "91e0cac6-eac1-4a49-93d7-95195e9565b8"}], "security_groups": [{"name": "tempest-securitygroup--1200029143"}], "key_name": "tempest-keypair-436932162", "user_data": "}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:50.233704 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] validate_networks() for [('91e0cac6-eac1-4a49-93d7-95195e9565b8', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:21:50.617564 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:21:50.617984 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:21:50.618446 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:21:50.618867 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:21:50.619270 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:21:50.628390 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:50.628825 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:50.629601 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:50.630022 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:50.646858 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Getting quotas for project 9e47b6f7a96c46dfa9906912efb7f265. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:21:50.651514 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Getting quotas for user 1f5f5b39c16f4cb38c12c33252786cc5 and project 9e47b6f7a96c46dfa9906912efb7f265. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:21:50.664935 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:21:50.667304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:21:50.716104 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ad479064-6888-4f76-94a6-bdac927dcb3d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.599164 Jun 28 03:21:50.716984 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 266/530] 10.222.0.44 () {62 vars in 1187 bytes} [Tue Jun 28 03:21:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 28 03:21:50.727713 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-26231ac0-50f3-44ed-85e4-a31f424cd171 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:50.728300 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-26231ac0-50f3-44ed-85e4-a31f424cd171 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:50.793087 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-26231ac0-50f3-44ed-85e4-a31f424cd171 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:50.801526 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-26231ac0-50f3-44ed-85e4-a31f424cd171 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:50.803173 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-26231ac0-50f3-44ed-85e4-a31f424cd171 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:50.804592 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-26231ac0-50f3-44ed-85e4-a31f424cd171 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1281 microversion: 2.20 time: 0.081240 Jun 28 03:21:50.805276 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 265/531] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:21:50 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:21:51.823110 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5c207f60-eb04-4c30-b569-2595fc9a4143 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:51.823694 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5c207f60-eb04-4c30-b569-2595fc9a4143 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:51.825734 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:51.832831 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c207f60-eb04-4c30-b569-2595fc9a4143 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:51.833221 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c207f60-eb04-4c30-b569-2595fc9a4143 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:51.834077 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c207f60-eb04-4c30-b569-2595fc9a4143 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:51.834478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c207f60-eb04-4c30-b569-2595fc9a4143 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:51.905003 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5c207f60-eb04-4c30-b569-2595fc9a4143 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:51.914074 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5c207f60-eb04-4c30-b569-2595fc9a4143 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:51.915011 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5c207f60-eb04-4c30-b569-2595fc9a4143 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:51.916100 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5c207f60-eb04-4c30-b569-2595fc9a4143 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1341 microversion: 2.20 time: 0.097039 Jun 28 03:21:51.916995 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 267/532] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:21:51 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1341 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:21:52.935050 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6fb08261-3173-4c9d-8897-5e9fed4a2912 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:52.935896 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6fb08261-3173-4c9d-8897-5e9fed4a2912 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:52.943586 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fb08261-3173-4c9d-8897-5e9fed4a2912 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:52.944336 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fb08261-3173-4c9d-8897-5e9fed4a2912 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:52.945112 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fb08261-3173-4c9d-8897-5e9fed4a2912 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:52.945543 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fb08261-3173-4c9d-8897-5e9fed4a2912 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:53.102659 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6fb08261-3173-4c9d-8897-5e9fed4a2912 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:53.111360 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6fb08261-3173-4c9d-8897-5e9fed4a2912 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:53.113151 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6fb08261-3173-4c9d-8897-5e9fed4a2912 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:53.114472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6fb08261-3173-4c9d-8897-5e9fed4a2912 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1407 microversion: 2.20 time: 0.183533 Jun 28 03:21:53.115039 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 266/533] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:21:52 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:21:53.652708 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-39d5739e-1db5-49b3-8621-af454c2c4aaa req-3389aa72-5de2-4cf8-a8d9-72b747d4a7bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e97b7a4-a1fb-4757-8d7f-d16a84c5561c", "tag": "02235355-6547-49bd-a247-cc3176e99f9e"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:53.661159 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-39d5739e-1db5-49b3-8621-af454c2c4aaa req-3389aa72-5de2-4cf8-a8d9-72b747d4a7bf service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:53.661450 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-39d5739e-1db5-49b3-8621-af454c2c4aaa req-3389aa72-5de2-4cf8-a8d9-72b747d4a7bf service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:53.673077 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-39d5739e-1db5-49b3-8621-af454c2c4aaa req-3389aa72-5de2-4cf8-a8d9-72b747d4a7bf service nova] Creating event network-changed:02235355-6547-49bd-a247-cc3176e99f9e for instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c on hv-cinder-84684 Jun 28 03:21:53.678199 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-39d5739e-1db5-49b3-8621-af454c2c4aaa req-3389aa72-5de2-4cf8-a8d9-72b747d4a7bf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029068 Jun 28 03:21:53.678863 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 268/534] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:21:54.135231 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ea944c1a-50a9-48cd-b6b8-6a0934d5d649 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:54.135932 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ea944c1a-50a9-48cd-b6b8-6a0934d5d649 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:54.142969 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea944c1a-50a9-48cd-b6b8-6a0934d5d649 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:54.143417 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea944c1a-50a9-48cd-b6b8-6a0934d5d649 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:54.144167 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea944c1a-50a9-48cd-b6b8-6a0934d5d649 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:54.144608 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea944c1a-50a9-48cd-b6b8-6a0934d5d649 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:54.290320 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ea944c1a-50a9-48cd-b6b8-6a0934d5d649 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:54.302518 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ea944c1a-50a9-48cd-b6b8-6a0934d5d649 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:54.303984 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ea944c1a-50a9-48cd-b6b8-6a0934d5d649 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:54.305147 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ea944c1a-50a9-48cd-b6b8-6a0934d5d649 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1407 microversion: 2.20 time: 0.175916 Jun 28 03:21:54.305723 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 267/535] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:21:54 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:21:55.324085 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fc7460da-bf54-4ff3-abf6-051b46a011d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:55.324767 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fc7460da-bf54-4ff3-abf6-051b46a011d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:55.331676 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fc7460da-bf54-4ff3-abf6-051b46a011d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:55.332331 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fc7460da-bf54-4ff3-abf6-051b46a011d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:55.333099 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fc7460da-bf54-4ff3-abf6-051b46a011d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:55.333523 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fc7460da-bf54-4ff3-abf6-051b46a011d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:55.337676 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:55.472968 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fc7460da-bf54-4ff3-abf6-051b46a011d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:55.481527 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fc7460da-bf54-4ff3-abf6-051b46a011d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:55.482972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fc7460da-bf54-4ff3-abf6-051b46a011d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:55.484099 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fc7460da-bf54-4ff3-abf6-051b46a011d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1407 microversion: 2.20 time: 0.164463 Jun 28 03:21:55.484693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 269/536] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:21:55 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:21:56.505406 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ca06430a-136d-482e-ac89-b538f0b3e62c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:56.506106 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ca06430a-136d-482e-ac89-b538f0b3e62c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:56.508834 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:21:56.515247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ca06430a-136d-482e-ac89-b538f0b3e62c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:56.515765 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ca06430a-136d-482e-ac89-b538f0b3e62c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:56.516687 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ca06430a-136d-482e-ac89-b538f0b3e62c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:56.517192 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ca06430a-136d-482e-ac89-b538f0b3e62c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:56.647174 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ca06430a-136d-482e-ac89-b538f0b3e62c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:56.655835 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ca06430a-136d-482e-ac89-b538f0b3e62c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:56.657337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ca06430a-136d-482e-ac89-b538f0b3e62c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:56.658437 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ca06430a-136d-482e-ac89-b538f0b3e62c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1407 microversion: 2.20 time: 0.159008 Jun 28 03:21:56.659269 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 268/537] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:21:56 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:21:57.682544 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-abb67044-f7bb-4957-8920-ca06ed3f1230 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:57.683167 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-abb67044-f7bb-4957-8920-ca06ed3f1230 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:57.689876 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-abb67044-f7bb-4957-8920-ca06ed3f1230 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:57.690447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-abb67044-f7bb-4957-8920-ca06ed3f1230 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:57.691192 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-abb67044-f7bb-4957-8920-ca06ed3f1230 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:57.691617 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-abb67044-f7bb-4957-8920-ca06ed3f1230 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:57.827467 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-abb67044-f7bb-4957-8920-ca06ed3f1230 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:57.840819 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-abb67044-f7bb-4957-8920-ca06ed3f1230 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:57.843108 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-abb67044-f7bb-4957-8920-ca06ed3f1230 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:57.844932 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-abb67044-f7bb-4957-8920-ca06ed3f1230 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1407 microversion: 2.20 time: 0.166089 Jun 28 03:21:57.845806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 270/538] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:21:57 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:21:58.866368 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-772df50d-1203-4eed-83ec-0fd623dac294 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:21:58.866984 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-772df50d-1203-4eed-83ec-0fd623dac294 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:21:58.874837 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-772df50d-1203-4eed-83ec-0fd623dac294 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:58.875332 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-772df50d-1203-4eed-83ec-0fd623dac294 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:58.876200 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-772df50d-1203-4eed-83ec-0fd623dac294 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:58.876683 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-772df50d-1203-4eed-83ec-0fd623dac294 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:59.023851 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-772df50d-1203-4eed-83ec-0fd623dac294 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:59.032314 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-772df50d-1203-4eed-83ec-0fd623dac294 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:59.033777 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-772df50d-1203-4eed-83ec-0fd623dac294 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:21:59.035000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-772df50d-1203-4eed-83ec-0fd623dac294 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1407 microversion: 2.20 time: 0.173754 Jun 28 03:21:59.035561 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 269/539] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:21:58 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:21:59.507640 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-a526ec88-8052-4b18-a08c-e12fbe3ca4d2 req-70e97a2a-c676-4ee3-9185-647fd10c4389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e97b7a4-a1fb-4757-8d7f-d16a84c5561c", "name": "network-vif-plugged", "status": "completed", "tag": "02235355-6547-49bd-a247-cc3176e99f9e"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:21:59.519015 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a526ec88-8052-4b18-a08c-e12fbe3ca4d2 req-70e97a2a-c676-4ee3-9185-647fd10c4389 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:21:59.519708 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a526ec88-8052-4b18-a08c-e12fbe3ca4d2 req-70e97a2a-c676-4ee3-9185-647fd10c4389 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:21:59.532553 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-a526ec88-8052-4b18-a08c-e12fbe3ca4d2 req-70e97a2a-c676-4ee3-9185-647fd10c4389 service nova] Creating event network-vif-plugged:02235355-6547-49bd-a247-cc3176e99f9e for instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c on hv-cinder-84684 Jun 28 03:21:59.538178 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-a526ec88-8052-4b18-a08c-e12fbe3ca4d2 req-70e97a2a-c676-4ee3-9185-647fd10c4389 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034134 Jun 28 03:21:59.538767 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 271/540] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:00.057525 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-775379ec-7b57-4e6a-9f10-7d5b54d0b576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:00.058526 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-775379ec-7b57-4e6a-9f10-7d5b54d0b576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:00.068455 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-775379ec-7b57-4e6a-9f10-7d5b54d0b576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:00.068894 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-775379ec-7b57-4e6a-9f10-7d5b54d0b576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:00.069642 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-775379ec-7b57-4e6a-9f10-7d5b54d0b576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:00.070062 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-775379ec-7b57-4e6a-9f10-7d5b54d0b576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:00.210703 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-775379ec-7b57-4e6a-9f10-7d5b54d0b576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:00.219038 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-775379ec-7b57-4e6a-9f10-7d5b54d0b576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:00.220533 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-775379ec-7b57-4e6a-9f10-7d5b54d0b576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:00.221623 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-775379ec-7b57-4e6a-9f10-7d5b54d0b576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1407 microversion: 2.20 time: 0.171030 Jun 28 03:22:00.222212 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 270/541] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:00 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:01.241174 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fc8a109f-e53e-419d-8054-8bc7cb4f3576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:01.241878 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fc8a109f-e53e-419d-8054-8bc7cb4f3576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:01.243841 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:01.244522 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:01.251304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fc8a109f-e53e-419d-8054-8bc7cb4f3576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:01.251735 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fc8a109f-e53e-419d-8054-8bc7cb4f3576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:01.252833 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fc8a109f-e53e-419d-8054-8bc7cb4f3576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:01.253247 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fc8a109f-e53e-419d-8054-8bc7cb4f3576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:01.391113 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fc8a109f-e53e-419d-8054-8bc7cb4f3576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:01.403983 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fc8a109f-e53e-419d-8054-8bc7cb4f3576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:01.406458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fc8a109f-e53e-419d-8054-8bc7cb4f3576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:01.408224 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fc8a109f-e53e-419d-8054-8bc7cb4f3576 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1407 microversion: 2.20 time: 0.171319 Jun 28 03:22:01.409059 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 272/542] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:01 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:02.428950 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2556b35e-56b9-4241-9287-d869d72a61b8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:02.429513 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2556b35e-56b9-4241-9287-d869d72a61b8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:02.431395 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=6 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:02.437711 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2556b35e-56b9-4241-9287-d869d72a61b8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:02.438144 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2556b35e-56b9-4241-9287-d869d72a61b8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:02.438897 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2556b35e-56b9-4241-9287-d869d72a61b8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:02.439321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2556b35e-56b9-4241-9287-d869d72a61b8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:02.569641 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2556b35e-56b9-4241-9287-d869d72a61b8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:02.577674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2556b35e-56b9-4241-9287-d869d72a61b8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:02.579121 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2556b35e-56b9-4241-9287-d869d72a61b8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:02.580294 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2556b35e-56b9-4241-9287-d869d72a61b8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1599 microversion: 2.20 time: 0.156847 Jun 28 03:22:02.580845 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 271/543] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:02 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:02.597812 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0a1405f8-2b23-4803-9755-b09af2145dc3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:02.598347 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0a1405f8-2b23-4803-9755-b09af2145dc3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:02.604727 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0a1405f8-2b23-4803-9755-b09af2145dc3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:02.605142 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0a1405f8-2b23-4803-9755-b09af2145dc3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:02.605890 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0a1405f8-2b23-4803-9755-b09af2145dc3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:02.606663 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0a1405f8-2b23-4803-9755-b09af2145dc3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:02.685171 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0a1405f8-2b23-4803-9755-b09af2145dc3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091288 Jun 28 03:22:02.685742 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 273/544] 10.222.0.44 () {60 vars in 1315 bytes} [Tue Jun 28 03:22:02 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:22:03.650226 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-4ed07519-f85e-4399-97ce-018153700e6f req-d9cacc95-236f-4829-a62b-2961a56af1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e97b7a4-a1fb-4757-8d7f-d16a84c5561c", "tag": "02235355-6547-49bd-a247-cc3176e99f9e"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:03.659233 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-4ed07519-f85e-4399-97ce-018153700e6f req-d9cacc95-236f-4829-a62b-2961a56af1b1 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:03.659760 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-4ed07519-f85e-4399-97ce-018153700e6f req-d9cacc95-236f-4829-a62b-2961a56af1b1 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:03.671192 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-4ed07519-f85e-4399-97ce-018153700e6f req-d9cacc95-236f-4829-a62b-2961a56af1b1 service nova] Creating event network-changed:02235355-6547-49bd-a247-cc3176e99f9e for instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c on hv-cinder-84684 Jun 28 03:22:03.676275 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-4ed07519-f85e-4399-97ce-018153700e6f req-d9cacc95-236f-4829-a62b-2961a56af1b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030356 Jun 28 03:22:03.676892 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 272/545] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:19.637639 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=13 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:19.638364 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=23 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:19.642759 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5b3baa76-8a83-46fa-badf-7c3ca9263f8a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cebc6dd4-8e1b-44f5-b9ae-2a3705a0874a"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:19.643842 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5b3baa76-8a83-46fa-badf-7c3ca9263f8a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:19.651346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5b3baa76-8a83-46fa-badf-7c3ca9263f8a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:19.651780 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5b3baa76-8a83-46fa-badf-7c3ca9263f8a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:19.652593 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5b3baa76-8a83-46fa-badf-7c3ca9263f8a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:19.653001 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5b3baa76-8a83-46fa-badf-7c3ca9263f8a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:19.950677 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5b3baa76-8a83-46fa-badf-7c3ca9263f8a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "POST /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313760 Jun 28 03:22:19.951386 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 274/546] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:22:19 2022] POST /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:21.479688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=9 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:21.480469 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=55 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:21.484992 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-5e9ec798-08c4-434c-8db6-b0ec805e3e35 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:21.485552 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-5e9ec798-08c4-434c-8db6-b0ec805e3e35 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:21.492559 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5e9ec798-08c4-434c-8db6-b0ec805e3e35 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:21.492995 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5e9ec798-08c4-434c-8db6-b0ec805e3e35 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:21.493735 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5e9ec798-08c4-434c-8db6-b0ec805e3e35 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:21.494176 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-5e9ec798-08c4-434c-8db6-b0ec805e3e35 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:21.517439 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-5e9ec798-08c4-434c-8db6-b0ec805e3e35 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/ips" status: 200 len: 149 microversion: 2.1 time: 0.040579 Jun 28 03:22:21.518013 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 273/547] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 28 03:22:21 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:22.856286 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-78845b97-9e14-40c2-b074-b31e4e189ec2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1dda37d-0f6e-4a15-b1c3-ee3bac396ec5"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:22.857522 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-78845b97-9e14-40c2-b074-b31e4e189ec2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:22.864191 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-78845b97-9e14-40c2-b074-b31e4e189ec2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:22.864661 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-78845b97-9e14-40c2-b074-b31e4e189ec2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:22.865420 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-78845b97-9e14-40c2-b074-b31e4e189ec2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:22.865847 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-78845b97-9e14-40c2-b074-b31e4e189ec2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:23.154188 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-78845b97-9e14-40c2-b074-b31e4e189ec2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "POST /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303106 Jun 28 03:22:23.154653 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 275/548] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:22:22 2022] POST /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:27.486157 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-44c99069-29b0-43f6-b470-9205afcbd638 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:27.487241 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-44c99069-29b0-43f6-b470-9205afcbd638 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:27.493941 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-44c99069-29b0-43f6-b470-9205afcbd638 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:27.494382 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-44c99069-29b0-43f6-b470-9205afcbd638 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:27.495132 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-44c99069-29b0-43f6-b470-9205afcbd638 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:27.495558 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-44c99069-29b0-43f6-b470-9205afcbd638 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:27.517999 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.objects.instance [None req-44c99069-29b0-43f6-b470-9205afcbd638 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lazy-loading 'flavor' on Instance uuid 88c49a8f-7779-4a9b-90dd-de3f851c517b {{(pid=117681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:22:27.654492 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-44c99069-29b0-43f6-b470-9205afcbd638 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "POST /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/action" status: 200 len: 32 microversion: 2.1 time: 0.172418 Jun 28 03:22:27.655291 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 274/549] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:22:27 2022] POST /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 03:22:27.665681 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e59420c9-d063-4002-8860-941ae9c46354 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:27.666370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e59420c9-d063-4002-8860-941ae9c46354 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:27.673520 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e59420c9-d063-4002-8860-941ae9c46354 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:27.673879 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e59420c9-d063-4002-8860-941ae9c46354 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:27.674633 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e59420c9-d063-4002-8860-941ae9c46354 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:27.675057 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e59420c9-d063-4002-8860-941ae9c46354 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:27.813716 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e59420c9-d063-4002-8860-941ae9c46354 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:27.821786 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e59420c9-d063-4002-8860-941ae9c46354 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.160823 Jun 28 03:22:27.822388 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 276/550] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:27 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:28.845520 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6a943f1c-b579-45a8-9cf4-cda57b498eff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:28.846633 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6a943f1c-b579-45a8-9cf4-cda57b498eff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:28.857860 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6a943f1c-b579-45a8-9cf4-cda57b498eff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:28.858475 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6a943f1c-b579-45a8-9cf4-cda57b498eff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:28.859232 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6a943f1c-b579-45a8-9cf4-cda57b498eff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:28.859659 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6a943f1c-b579-45a8-9cf4-cda57b498eff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:29.011301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6a943f1c-b579-45a8-9cf4-cda57b498eff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:29.020079 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6a943f1c-b579-45a8-9cf4-cda57b498eff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.182807 Jun 28 03:22:29.020677 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 275/551] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:28 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:30.041644 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f1c0cf21-9161-4a71-a89f-98566657c3f7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:30.042598 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f1c0cf21-9161-4a71-a89f-98566657c3f7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:30.054539 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f1c0cf21-9161-4a71-a89f-98566657c3f7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:30.055285 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f1c0cf21-9161-4a71-a89f-98566657c3f7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:30.056585 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f1c0cf21-9161-4a71-a89f-98566657c3f7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:30.057294 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f1c0cf21-9161-4a71-a89f-98566657c3f7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:30.195221 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f1c0cf21-9161-4a71-a89f-98566657c3f7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:30.208648 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f1c0cf21-9161-4a71-a89f-98566657c3f7 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.173304 Jun 28 03:22:30.209551 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 277/552] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:30 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:31.228756 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b5f8ca39-ce29-432f-b93c-84b2c4107ca5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:31.229477 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b5f8ca39-ce29-432f-b93c-84b2c4107ca5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:31.237874 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b5f8ca39-ce29-432f-b93c-84b2c4107ca5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:31.238335 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b5f8ca39-ce29-432f-b93c-84b2c4107ca5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:31.239696 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b5f8ca39-ce29-432f-b93c-84b2c4107ca5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:31.240137 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b5f8ca39-ce29-432f-b93c-84b2c4107ca5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:31.395063 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b5f8ca39-ce29-432f-b93c-84b2c4107ca5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:31.412769 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b5f8ca39-ce29-432f-b93c-84b2c4107ca5 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.188534 Jun 28 03:22:31.413503 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 276/553] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:31 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:32.434565 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-20ba462a-7ca2-46e8-aba4-bac4c17fb74f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:32.435148 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-20ba462a-7ca2-46e8-aba4-bac4c17fb74f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:32.442273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20ba462a-7ca2-46e8-aba4-bac4c17fb74f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:32.442719 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20ba462a-7ca2-46e8-aba4-bac4c17fb74f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:32.443474 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20ba462a-7ca2-46e8-aba4-bac4c17fb74f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:32.443897 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20ba462a-7ca2-46e8-aba4-bac4c17fb74f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:32.586095 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-20ba462a-7ca2-46e8-aba4-bac4c17fb74f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:32.597459 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-20ba462a-7ca2-46e8-aba4-bac4c17fb74f tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.166885 Jun 28 03:22:32.598031 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 278/554] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:32 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:33.614737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-0975480f-102c-48b8-970d-b7d6747e2314 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:33.615340 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-0975480f-102c-48b8-970d-b7d6747e2314 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:33.622401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0975480f-102c-48b8-970d-b7d6747e2314 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:33.622843 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0975480f-102c-48b8-970d-b7d6747e2314 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:33.623592 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0975480f-102c-48b8-970d-b7d6747e2314 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:33.624018 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0975480f-102c-48b8-970d-b7d6747e2314 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:33.775771 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-0975480f-102c-48b8-970d-b7d6747e2314 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:33.784023 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-0975480f-102c-48b8-970d-b7d6747e2314 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.173255 Jun 28 03:22:33.784642 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 277/555] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:33 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:33.907119 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d4a5f8e6-1ff2-45df-bf70-251e33fe4ba4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1dda37d-0f6e-4a15-b1c3-ee3bac396ec5"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:33.908255 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d4a5f8e6-1ff2-45df-bf70-251e33fe4ba4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:33.914883 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d4a5f8e6-1ff2-45df-bf70-251e33fe4ba4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:33.915325 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d4a5f8e6-1ff2-45df-bf70-251e33fe4ba4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:33.916070 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d4a5f8e6-1ff2-45df-bf70-251e33fe4ba4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:33.916527 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d4a5f8e6-1ff2-45df-bf70-251e33fe4ba4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:34.004606 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-d4a5f8e6-1ff2-45df-bf70-251e33fe4ba4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Invalid volume: volume c1dda37d-0f6e-4a15-b1c3-ee3bac396ec5 is already attached to instances: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d4a5f8e6-1ff2-45df-bf70-251e33fe4ba4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: POST /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/os-volume_attachments HTTP/1.1 Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 74 Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:22:34.006536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:22:34.008005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:22:34.008005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:22:34.008005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:22:34.008005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:22:34.008005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:22:34.008005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:22:34.008005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:22:34.008005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:22:34.008005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:22:34.008005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Jun 28 03:22:34.008005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {"volumeAttachment": {"volumeId": "c1dda37d-0f6e-4a15-b1c3-ee3bac396ec5"}} Jun 28 03:22:34.008005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Invalid volume: volume c1dda37d-0f6e-4a15-b1c3-ee3bac396ec5 is already attached to instances: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'server_id': '87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da', 'body': {'volumeAttachment': {'volumeId': 'c1dda37d-0f6e-4a15-b1c3-ee3bac396ec5'}}} Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c1dda37d-0f6e-4a15-b1c3-ee3bac396ec5 is already attached to instances: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:22:34.008775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c1dda37d-0f6e-4a15-b1c3-ee3bac396ec5 is already attached to instances: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:22:34.009898 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:22:34.011044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:22:34.011044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:22:34.011044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:22:34.011044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c1dda37d-0f6e-4a15-b1c3-ee3bac396ec5 is already attached to instances: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da Jun 28 03:22:34.011044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:22:34.011044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d4a5f8e6-1ff2-45df-bf70-251e33fe4ba4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 400 to user: Invalid volume: volume c1dda37d-0f6e-4a15-b1c3-ee3bac396ec5 is already attached to instances: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:22:34.011044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d4a5f8e6-1ff2-45df-bf70-251e33fe4ba4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "POST /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105011 Jun 28 03:22:34.011044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 279/556] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:22:33 2022] POST /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 28 03:22:34.069275 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f77dbccb-62c2-4084-aa2d-fe3beb262279 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:34.069759 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f77dbccb-62c2-4084-aa2d-fe3beb262279 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:34.075872 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f77dbccb-62c2-4084-aa2d-fe3beb262279 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:34.076354 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f77dbccb-62c2-4084-aa2d-fe3beb262279 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:34.077096 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f77dbccb-62c2-4084-aa2d-fe3beb262279 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:34.077519 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f77dbccb-62c2-4084-aa2d-fe3beb262279 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:34.198816 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.objects.instance [None req-f77dbccb-62c2-4084-aa2d-fe3beb262279 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lazy-loading 'services' on Instance uuid 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da {{(pid=117681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:22:34.318345 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f77dbccb-62c2-4084-aa2d-fe3beb262279 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/os-volume_attachments/c1dda37d-0f6e-4a15-b1c3-ee3bac396ec5" status: 202 len: 0 microversion: 2.1 time: 0.252887 Jun 28 03:22:34.319148 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 278/557] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 28 03:22:34 2022] DELETE /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/os-volume_attachments/c1dda37d-0f6e-4a15-b1c3-ee3bac396ec5 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:22:34.330195 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3475c7aa-7437-4adb-8f58-1080a81ac6b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:34.331145 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3475c7aa-7437-4adb-8f58-1080a81ac6b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:34.338281 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3475c7aa-7437-4adb-8f58-1080a81ac6b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:34.338714 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3475c7aa-7437-4adb-8f58-1080a81ac6b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:34.339467 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3475c7aa-7437-4adb-8f58-1080a81ac6b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:34.339983 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3475c7aa-7437-4adb-8f58-1080a81ac6b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:34.371265 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3475c7aa-7437-4adb-8f58-1080a81ac6b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046183 Jun 28 03:22:34.371794 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 280/558] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:22:34 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:34.802016 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-1a552e68-ab2d-4663-82db-ae616a2d60ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:34.802701 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-1a552e68-ab2d-4663-82db-ae616a2d60ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:34.809607 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1a552e68-ab2d-4663-82db-ae616a2d60ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:34.810052 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1a552e68-ab2d-4663-82db-ae616a2d60ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:34.810806 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1a552e68-ab2d-4663-82db-ae616a2d60ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:34.811235 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1a552e68-ab2d-4663-82db-ae616a2d60ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:34.940634 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-1a552e68-ab2d-4663-82db-ae616a2d60ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:34.949008 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-1a552e68-ab2d-4663-82db-ae616a2d60ce tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.151199 Jun 28 03:22:34.949582 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 279/559] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:34 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:35.386738 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f96e6cc7-b84a-421b-a27b-e667f8762264 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:35.388109 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f96e6cc7-b84a-421b-a27b-e667f8762264 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:35.397769 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f96e6cc7-b84a-421b-a27b-e667f8762264 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:35.398442 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f96e6cc7-b84a-421b-a27b-e667f8762264 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:35.399596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f96e6cc7-b84a-421b-a27b-e667f8762264 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:35.400315 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f96e6cc7-b84a-421b-a27b-e667f8762264 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:35.433719 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f96e6cc7-b84a-421b-a27b-e667f8762264 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053296 Jun 28 03:22:35.434286 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 281/560] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:22:35 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 03:22:35.493222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b513a3e2-3af0-44ed-a0a7-05af0690fa16 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:35.493667 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b513a3e2-3af0-44ed-a0a7-05af0690fa16 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:35.500069 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b513a3e2-3af0-44ed-a0a7-05af0690fa16 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:35.500726 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b513a3e2-3af0-44ed-a0a7-05af0690fa16 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:35.501492 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b513a3e2-3af0-44ed-a0a7-05af0690fa16 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:35.501959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b513a3e2-3af0-44ed-a0a7-05af0690fa16 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:35.526653 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b513a3e2-3af0-44ed-a0a7-05af0690fa16 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Going to try to terminate instance {{(pid=117681) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:22:35.620639 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b513a3e2-3af0-44ed-a0a7-05af0690fa16 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 204 len: 0 microversion: 2.1 time: 0.130844 Jun 28 03:22:35.621397 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 280/561] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:22:35 2022] DELETE /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:22:35.630115 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-01059b3c-827c-447f-9c26-3cb4b263a9c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:35.630708 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-01059b3c-827c-447f-9c26-3cb4b263a9c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:35.636843 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-01059b3c-827c-447f-9c26-3cb4b263a9c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:35.637282 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-01059b3c-827c-447f-9c26-3cb4b263a9c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:35.638025 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-01059b3c-827c-447f-9c26-3cb4b263a9c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:35.638447 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-01059b3c-827c-447f-9c26-3cb4b263a9c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:35.776768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-01059b3c-827c-447f-9c26-3cb4b263a9c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:35.784961 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-01059b3c-827c-447f-9c26-3cb4b263a9c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 200 len: 1681 microversion: 2.1 time: 0.158847 Jun 28 03:22:35.785535 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 282/562] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:35 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:35.971496 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-63556264-9b9c-443a-8b7d-49cc20114ef9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:35.972227 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-63556264-9b9c-443a-8b7d-49cc20114ef9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:35.979113 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-63556264-9b9c-443a-8b7d-49cc20114ef9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:35.979558 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-63556264-9b9c-443a-8b7d-49cc20114ef9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:35.980693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-63556264-9b9c-443a-8b7d-49cc20114ef9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:35.981113 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-63556264-9b9c-443a-8b7d-49cc20114ef9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:36.111857 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-63556264-9b9c-443a-8b7d-49cc20114ef9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:36.120606 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-63556264-9b9c-443a-8b7d-49cc20114ef9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.155698 Jun 28 03:22:36.121167 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 281/563] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:35 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:36.802793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-42c5590c-7ed9-443f-82ef-2d9c15d8b5eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:36.803372 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-42c5590c-7ed9-443f-82ef-2d9c15d8b5eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:36.810841 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-42c5590c-7ed9-443f-82ef-2d9c15d8b5eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:36.811308 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-42c5590c-7ed9-443f-82ef-2d9c15d8b5eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:36.812134 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-42c5590c-7ed9-443f-82ef-2d9c15d8b5eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:36.812649 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-42c5590c-7ed9-443f-82ef-2d9c15d8b5eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:36.948557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-42c5590c-7ed9-443f-82ef-2d9c15d8b5eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:36.960712 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-42c5590c-7ed9-443f-82ef-2d9c15d8b5eb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 200 len: 1681 microversion: 2.1 time: 0.161653 Jun 28 03:22:36.961523 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 283/564] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:36 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:37.141834 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-702d098e-d439-45aa-9aa7-9bbadc997b48 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:37.142397 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-702d098e-d439-45aa-9aa7-9bbadc997b48 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:37.149407 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-702d098e-d439-45aa-9aa7-9bbadc997b48 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:37.149855 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-702d098e-d439-45aa-9aa7-9bbadc997b48 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:37.150605 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-702d098e-d439-45aa-9aa7-9bbadc997b48 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:37.151035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-702d098e-d439-45aa-9aa7-9bbadc997b48 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:37.283828 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-702d098e-d439-45aa-9aa7-9bbadc997b48 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:37.292029 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-702d098e-d439-45aa-9aa7-9bbadc997b48 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.156433 Jun 28 03:22:37.292642 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 282/565] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:37 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:37.981330 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e7e53ce0-2f6a-4fd6-8a85-5dac629c8087 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:37.981913 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e7e53ce0-2f6a-4fd6-8a85-5dac629c8087 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:37.989327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7e53ce0-2f6a-4fd6-8a85-5dac629c8087 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:37.989782 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7e53ce0-2f6a-4fd6-8a85-5dac629c8087 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:37.990540 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7e53ce0-2f6a-4fd6-8a85-5dac629c8087 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:37.990968 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7e53ce0-2f6a-4fd6-8a85-5dac629c8087 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:38.053918 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e7e53ce0-2f6a-4fd6-8a85-5dac629c8087 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:38.061646 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e7e53ce0-2f6a-4fd6-8a85-5dac629c8087 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 200 len: 1613 microversion: 2.1 time: 0.084564 Jun 28 03:22:38.062194 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 284/566] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:37 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:38.235244 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-af47018e-754f-472f-9922-f8d84cda2ba2 req-ec37b43e-a041-4788-8309-0adddc380379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da", "name": "network-vif-deleted", "tag": "7bac8765-f69c-4d0f-8f64-222af3fb6108"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:38.246137 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-af47018e-754f-472f-9922-f8d84cda2ba2 req-ec37b43e-a041-4788-8309-0adddc380379 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:38.246586 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-af47018e-754f-472f-9922-f8d84cda2ba2 req-ec37b43e-a041-4788-8309-0adddc380379 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:38.259609 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-af47018e-754f-472f-9922-f8d84cda2ba2 req-ec37b43e-a041-4788-8309-0adddc380379 service nova] Creating event network-vif-deleted:7bac8765-f69c-4d0f-8f64-222af3fb6108 for instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da on hv-cinder-84684 Jun 28 03:22:38.264828 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-af47018e-754f-472f-9922-f8d84cda2ba2 req-ec37b43e-a041-4788-8309-0adddc380379 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033307 Jun 28 03:22:38.265880 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 283/567] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:38.309876 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6bf2fc5f-f3ef-4d94-8140-3e233a7fef92 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:38.310526 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6bf2fc5f-f3ef-4d94-8140-3e233a7fef92 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:38.317892 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6bf2fc5f-f3ef-4d94-8140-3e233a7fef92 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:38.318339 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6bf2fc5f-f3ef-4d94-8140-3e233a7fef92 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:38.320409 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6bf2fc5f-f3ef-4d94-8140-3e233a7fef92 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:38.320848 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6bf2fc5f-f3ef-4d94-8140-3e233a7fef92 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:38.478456 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6bf2fc5f-f3ef-4d94-8140-3e233a7fef92 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:38.487007 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6bf2fc5f-f3ef-4d94-8140-3e233a7fef92 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.181257 Jun 28 03:22:38.487576 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 285/568] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:38 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:39.079366 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-90dc4079-8b39-4f2b-8004-582136cec84f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:39.080146 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-90dc4079-8b39-4f2b-8004-582136cec84f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:39.087156 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-90dc4079-8b39-4f2b-8004-582136cec84f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:39.087511 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-90dc4079-8b39-4f2b-8004-582136cec84f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:39.088349 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-90dc4079-8b39-4f2b-8004-582136cec84f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:39.088860 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-90dc4079-8b39-4f2b-8004-582136cec84f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:39.102949 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-90dc4079-8b39-4f2b-8004-582136cec84f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-90dc4079-8b39-4f2b-8004-582136cec84f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da HTTP/1.1 Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:22:39.104647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:22:39.106293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:22:39.106293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:22:39.106293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:22:39.106293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:22:39.106293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:22:39.106293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:22:39.106293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:22:39.106293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:22:39.106293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:22:39.106293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:22:39.106293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:22:39.106293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da'} Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:22:39.107000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:22:39.108135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:22:39.109769 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-90dc4079-8b39-4f2b-8004-582136cec84f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 404 to user: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:22:39.109769 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-90dc4079-8b39-4f2b-8004-582136cec84f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 404 len: 111 microversion: 2.1 time: 0.031107 Jun 28 03:22:39.109769 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 284/569] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:39 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:22:39.115694 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-eed5c4cf-21a1-4242-85ea-1b944d05d65c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '.version_select at 0x7f53f27a4040>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:39.135731 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-eed5c4cf-21a1-4242-85ea-1b944d05d65c tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-357650152" status: 202 len: 0 microversion: 2.1 time: 0.023867 Jun 28 03:22:39.139551 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 286/570] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jun 28 03:22:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-357650152 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:22:39.504663 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-67cb503a-7a58-4bcd-be62-c8901171daff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:39.505399 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-67cb503a-7a58-4bcd-be62-c8901171daff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:39.512473 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-67cb503a-7a58-4bcd-be62-c8901171daff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:39.512917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-67cb503a-7a58-4bcd-be62-c8901171daff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:39.513825 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-67cb503a-7a58-4bcd-be62-c8901171daff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:39.514251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-67cb503a-7a58-4bcd-be62-c8901171daff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:39.649738 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-67cb503a-7a58-4bcd-be62-c8901171daff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:39.658713 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-67cb503a-7a58-4bcd-be62-c8901171daff tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.157897 Jun 28 03:22:39.659483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 285/571] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:39 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:39.754038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-451e5f47-49a8-4d61-ab1f-2789ee8138ee tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Action: 'create', calling method: .version_select at 0x7f53f1b2fa60>, body: {"keypair": {"name": "tempest-keypair-968240381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh8O/2tCLWxDVRR66K26Y8FUwGK0ddZ/23crKde2Qzl6hSY2eZZCDzwqqHqRYjLsvbWCIYXD7yRN5zpaYMtUihcl+KwmoA/72wRi3rC5QkROnC2Z1eNyJC1p5gONl+/qw=="}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:39.769574 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-451e5f47-49a8-4d61-ab1f-2789ee8138ee tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for project 63f6b05085584fd5beecbe54c7251525. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:22:39.773777 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-451e5f47-49a8-4d61-ab1f-2789ee8138ee tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for user 4181737f6f2348d2906aea642b8598f7 and project 63f6b05085584fd5beecbe54c7251525. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:22:39.797763 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-451e5f47-49a8-4d61-ab1f-2789ee8138ee tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047734 Jun 28 03:22:39.798348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 287/572] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 28 03:22:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:39.912263 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-35a7b205-e8d9-4d24-9f19-d2a40d154269 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:39.912754 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-35a7b205-e8d9-4d24-9f19-d2a40d154269 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:39.918936 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-35a7b205-e8d9-4d24-9f19-d2a40d154269 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:39.919408 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-35a7b205-e8d9-4d24-9f19-d2a40d154269 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:39.920184 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-35a7b205-e8d9-4d24-9f19-d2a40d154269 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:39.920626 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-35a7b205-e8d9-4d24-9f19-d2a40d154269 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:39.944037 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-35a7b205-e8d9-4d24-9f19-d2a40d154269 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/ips" status: 200 len: 151 microversion: 2.20 time: 0.035712 Jun 28 03:22:39.944783 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 286/573] 10.222.0.44 () {60 vars in 1288 bytes} [Tue Jun 28 03:22:39 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:22:40.676254 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e19d3419-546d-4d93-9471-7699fa9b59fd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:40.676890 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e19d3419-546d-4d93-9471-7699fa9b59fd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:40.685171 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e19d3419-546d-4d93-9471-7699fa9b59fd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:40.685711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e19d3419-546d-4d93-9471-7699fa9b59fd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:40.686513 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e19d3419-546d-4d93-9471-7699fa9b59fd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:40.686919 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e19d3419-546d-4d93-9471-7699fa9b59fd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:40.875273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e19d3419-546d-4d93-9471-7699fa9b59fd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:40.883703 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e19d3419-546d-4d93-9471-7699fa9b59fd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.212224 Jun 28 03:22:40.884335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 288/574] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:40 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:41.185960 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1882797911", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "78d460e7-819f-442d-8ddd-fecab5b4b6fc"}], "security_groups": [{"name": "tempest-securitygroup--1249219226"}], "key_name": "tempest-keypair-968240381", "user_data": "}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:41.299645 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.network.neutron [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] validate_networks() for [('78d460e7-819f-442d-8ddd-fecab5b4b6fc', None, None, None, None, None)] {{(pid=117681) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:22:41.901971 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-db753b01-0688-437c-abad-87d143efaada tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:41.902577 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-db753b01-0688-437c-abad-87d143efaada tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:41.910244 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-db753b01-0688-437c-abad-87d143efaada tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:41.910974 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-db753b01-0688-437c-abad-87d143efaada tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:41.911717 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-db753b01-0688-437c-abad-87d143efaada tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:41.912190 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-db753b01-0688-437c-abad-87d143efaada tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:42.001605 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Flavor limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:22:42.002123 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Image limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:22:42.002684 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Flavor pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:22:42.003155 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Image pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:22:42.003646 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:22:42.012753 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:42.013192 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:42.013973 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:42.014395 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:42.021367 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:42.033887 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for project 63f6b05085584fd5beecbe54c7251525. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:22:42.038516 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Getting quotas for user 4181737f6f2348d2906aea642b8598f7 and project 63f6b05085584fd5beecbe54c7251525. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:22:42.049979 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Going to run 1 instances... {{(pid=117681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:22:42.052273 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:22:42.062694 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-db753b01-0688-437c-abad-87d143efaada tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:42.066414 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:42.071918 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-db753b01-0688-437c-abad-87d143efaada tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.174349 Jun 28 03:22:42.072563 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 289/575] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:41 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:42.099472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-75040d15-6538-46ff-8aeb-d6148bd8fd29 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.917881 Jun 28 03:22:42.100119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 287/576] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:22:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:22:42.110606 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a7a09dac-8dd8-40b2-93e0-b26a3c8b0629 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:42.111210 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a7a09dac-8dd8-40b2-93e0-b26a3c8b0629 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:42.168792 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a7a09dac-8dd8-40b2-93e0-b26a3c8b0629 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:42.176006 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a7a09dac-8dd8-40b2-93e0-b26a3c8b0629 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1241 microversion: 2.1 time: 0.069190 Jun 28 03:22:42.176662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 290/577] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:42 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:42.295474 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-63060590-9f26-4c13-8ba6-8b6fda44097e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:42.296005 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-63060590-9f26-4c13-8ba6-8b6fda44097e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:42.304414 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-63060590-9f26-4c13-8ba6-8b6fda44097e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:42.304972 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-63060590-9f26-4c13-8ba6-8b6fda44097e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:42.305829 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-63060590-9f26-4c13-8ba6-8b6fda44097e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:42.306118 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-63060590-9f26-4c13-8ba6-8b6fda44097e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:42.332004 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.objects.instance [None req-63060590-9f26-4c13-8ba6-8b6fda44097e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lazy-loading 'flavor' on Instance uuid 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c {{(pid=117681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:22:42.817900 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-63060590-9f26-4c13-8ba6-8b6fda44097e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "POST /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/action" status: 202 len: 0 microversion: 2.20 time: 0.526276 Jun 28 03:22:42.821545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 288/578] 10.222.0.44 () {62 vars in 1318 bytes} [Tue Jun 28 03:22:42 2022] POST /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:22:42.827336 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-69dc8881-408f-4616-8cf3-20b9b2c7908c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:42.828000 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-69dc8881-408f-4616-8cf3-20b9b2c7908c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:42.835068 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-69dc8881-408f-4616-8cf3-20b9b2c7908c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:42.835517 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-69dc8881-408f-4616-8cf3-20b9b2c7908c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:42.836314 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-69dc8881-408f-4616-8cf3-20b9b2c7908c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:42.836737 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-69dc8881-408f-4616-8cf3-20b9b2c7908c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:42.972773 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-69dc8881-408f-4616-8cf3-20b9b2c7908c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:42.985902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-69dc8881-408f-4616-8cf3-20b9b2c7908c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:42.988221 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-69dc8881-408f-4616-8cf3-20b9b2c7908c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:42.990024 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-69dc8881-408f-4616-8cf3-20b9b2c7908c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1723 microversion: 2.20 time: 0.166861 Jun 28 03:22:42.990823 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 291/579] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:42 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:43.095277 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6ca82809-efc1-477c-ac66-5253c87494ca tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:43.096431 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6ca82809-efc1-477c-ac66-5253c87494ca tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:43.107229 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6ca82809-efc1-477c-ac66-5253c87494ca tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:43.108015 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6ca82809-efc1-477c-ac66-5253c87494ca tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:43.109451 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6ca82809-efc1-477c-ac66-5253c87494ca tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:43.109910 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6ca82809-efc1-477c-ac66-5253c87494ca tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:43.193357 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8c4fd8da-9a17-42b1-bf2d-768ed9dd8cdb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:43.194073 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8c4fd8da-9a17-42b1-bf2d-768ed9dd8cdb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:43.200498 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8c4fd8da-9a17-42b1-bf2d-768ed9dd8cdb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:43.200953 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8c4fd8da-9a17-42b1-bf2d-768ed9dd8cdb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:43.201700 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8c4fd8da-9a17-42b1-bf2d-768ed9dd8cdb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:43.202478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8c4fd8da-9a17-42b1-bf2d-768ed9dd8cdb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:43.274322 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8c4fd8da-9a17-42b1-bf2d-768ed9dd8cdb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:43.277670 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6ca82809-efc1-477c-ac66-5253c87494ca tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:43.282621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8c4fd8da-9a17-42b1-bf2d-768ed9dd8cdb tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1293 microversion: 2.1 time: 0.093235 Jun 28 03:22:43.283171 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 292/580] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:43 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:22:43.285885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6ca82809-efc1-477c-ac66-5253c87494ca tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.197844 Jun 28 03:22:43.286437 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 289/581] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:43 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:44.013591 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0fb19ead-104a-4c1e-a7ec-5b498ce41987 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:44.014531 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0fb19ead-104a-4c1e-a7ec-5b498ce41987 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:44.022215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0fb19ead-104a-4c1e-a7ec-5b498ce41987 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:44.022656 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0fb19ead-104a-4c1e-a7ec-5b498ce41987 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:44.023404 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0fb19ead-104a-4c1e-a7ec-5b498ce41987 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:44.023828 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0fb19ead-104a-4c1e-a7ec-5b498ce41987 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:44.154651 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0fb19ead-104a-4c1e-a7ec-5b498ce41987 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:44.163090 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0fb19ead-104a-4c1e-a7ec-5b498ce41987 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:44.164628 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0fb19ead-104a-4c1e-a7ec-5b498ce41987 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:44.165791 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0fb19ead-104a-4c1e-a7ec-5b498ce41987 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1723 microversion: 2.20 time: 0.158956 Jun 28 03:22:44.166350 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 293/582] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:44 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:44.306899 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-77fd6b4b-4d53-41ee-a48d-20a449510ea3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:44.307712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-77fd6b4b-4d53-41ee-a48d-20a449510ea3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:44.310514 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7b0d5a85-b509-4f42-bee9-df98bf49b7d8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:44.311525 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7b0d5a85-b509-4f42-bee9-df98bf49b7d8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:44.316684 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-77fd6b4b-4d53-41ee-a48d-20a449510ea3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:44.317131 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-77fd6b4b-4d53-41ee-a48d-20a449510ea3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:44.317891 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-77fd6b4b-4d53-41ee-a48d-20a449510ea3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:44.318311 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7b0d5a85-b509-4f42-bee9-df98bf49b7d8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:44.318480 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-77fd6b4b-4d53-41ee-a48d-20a449510ea3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:44.318759 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7b0d5a85-b509-4f42-bee9-df98bf49b7d8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:44.319500 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7b0d5a85-b509-4f42-bee9-df98bf49b7d8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:44.319921 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7b0d5a85-b509-4f42-bee9-df98bf49b7d8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:44.389182 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-77fd6b4b-4d53-41ee-a48d-20a449510ea3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:44.397027 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-77fd6b4b-4d53-41ee-a48d-20a449510ea3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1299 microversion: 2.1 time: 0.096777 Jun 28 03:22:44.397580 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 290/583] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:44 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:44.517387 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7b0d5a85-b509-4f42-bee9-df98bf49b7d8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:44.525462 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7b0d5a85-b509-4f42-bee9-df98bf49b7d8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.221369 Jun 28 03:22:44.526034 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 294/584] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:44 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:45.184825 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-25b07a02-2215-42e0-b047-fb577c60450d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:45.185415 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-25b07a02-2215-42e0-b047-fb577c60450d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:45.192134 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-25b07a02-2215-42e0-b047-fb577c60450d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:45.192606 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-25b07a02-2215-42e0-b047-fb577c60450d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:45.193358 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-25b07a02-2215-42e0-b047-fb577c60450d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:45.193778 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-25b07a02-2215-42e0-b047-fb577c60450d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:45.325710 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-25b07a02-2215-42e0-b047-fb577c60450d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:45.334086 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-25b07a02-2215-42e0-b047-fb577c60450d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:45.335560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-25b07a02-2215-42e0-b047-fb577c60450d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:45.336970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-25b07a02-2215-42e0-b047-fb577c60450d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1723 microversion: 2.20 time: 0.156227 Jun 28 03:22:45.337508 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 291/585] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:45 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:45.413955 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-da43e72e-1a9e-4f3b-93db-d0205fe03d73 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:45.414556 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-da43e72e-1a9e-4f3b-93db-d0205fe03d73 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:45.421689 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-da43e72e-1a9e-4f3b-93db-d0205fe03d73 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:45.422136 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-da43e72e-1a9e-4f3b-93db-d0205fe03d73 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:45.423027 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-da43e72e-1a9e-4f3b-93db-d0205fe03d73 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:45.423514 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-da43e72e-1a9e-4f3b-93db-d0205fe03d73 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:45.543030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b46d7a52-318a-4736-9878-cc5d818551bc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:45.543627 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b46d7a52-318a-4736-9878-cc5d818551bc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:45.549999 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b46d7a52-318a-4736-9878-cc5d818551bc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:45.550443 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b46d7a52-318a-4736-9878-cc5d818551bc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:45.551200 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b46d7a52-318a-4736-9878-cc5d818551bc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:45.551626 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b46d7a52-318a-4736-9878-cc5d818551bc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:45.560061 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-da43e72e-1a9e-4f3b-93db-d0205fe03d73 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:45.568084 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-da43e72e-1a9e-4f3b-93db-d0205fe03d73 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1367 microversion: 2.1 time: 0.158049 Jun 28 03:22:45.568755 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 295/586] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:45 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:45.687110 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b46d7a52-318a-4736-9878-cc5d818551bc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:45.695305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b46d7a52-318a-4736-9878-cc5d818551bc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.156151 Jun 28 03:22:45.695869 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 292/587] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:45 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:46.356193 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-415a30f2-1ebc-4909-8ac5-5c106f35bcb8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:46.356838 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-415a30f2-1ebc-4909-8ac5-5c106f35bcb8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:46.364613 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-415a30f2-1ebc-4909-8ac5-5c106f35bcb8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:46.365069 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-415a30f2-1ebc-4909-8ac5-5c106f35bcb8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:46.365862 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-415a30f2-1ebc-4909-8ac5-5c106f35bcb8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:46.366288 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-415a30f2-1ebc-4909-8ac5-5c106f35bcb8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:46.373322 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-5ff58419-9d0a-4e65-912d-774ab206fde5 req-6ac9ac9c-c33f-4e3a-a371-1fb905f375cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb95203-3c4a-4225-9282-bd035696ef59", "tag": "cfd747c8-04ee-403a-8dcd-75a533cbca9e"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:46.382935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-5ff58419-9d0a-4e65-912d-774ab206fde5 req-6ac9ac9c-c33f-4e3a-a371-1fb905f375cb service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:46.383792 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-5ff58419-9d0a-4e65-912d-774ab206fde5 req-6ac9ac9c-c33f-4e3a-a371-1fb905f375cb service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:46.398254 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-5ff58419-9d0a-4e65-912d-774ab206fde5 req-6ac9ac9c-c33f-4e3a-a371-1fb905f375cb service nova] Creating event network-changed:cfd747c8-04ee-403a-8dcd-75a533cbca9e for instance 0eb95203-3c4a-4225-9282-bd035696ef59 on hv-cinder-84684 Jun 28 03:22:46.406294 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-5ff58419-9d0a-4e65-912d-774ab206fde5 req-6ac9ac9c-c33f-4e3a-a371-1fb905f375cb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036825 Jun 28 03:22:46.408009 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 293/588] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:46.506034 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-415a30f2-1ebc-4909-8ac5-5c106f35bcb8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:46.514867 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-415a30f2-1ebc-4909-8ac5-5c106f35bcb8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:46.516414 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-415a30f2-1ebc-4909-8ac5-5c106f35bcb8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:46.517578 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-415a30f2-1ebc-4909-8ac5-5c106f35bcb8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1723 microversion: 2.20 time: 0.165817 Jun 28 03:22:46.518139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 296/589] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:46 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:46.586720 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f531b82c-fcee-45d8-9fe9-32256d54f6be tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:46.587406 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f531b82c-fcee-45d8-9fe9-32256d54f6be tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:46.595045 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f531b82c-fcee-45d8-9fe9-32256d54f6be tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:46.595515 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f531b82c-fcee-45d8-9fe9-32256d54f6be tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:46.596353 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f531b82c-fcee-45d8-9fe9-32256d54f6be tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:46.596844 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f531b82c-fcee-45d8-9fe9-32256d54f6be tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:46.717791 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-49e6f53a-eaae-4b11-86fe-a1bd14e72806 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:46.718866 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-49e6f53a-eaae-4b11-86fe-a1bd14e72806 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:46.725947 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-49e6f53a-eaae-4b11-86fe-a1bd14e72806 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:46.726685 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-49e6f53a-eaae-4b11-86fe-a1bd14e72806 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:46.727706 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-49e6f53a-eaae-4b11-86fe-a1bd14e72806 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:46.728374 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-49e6f53a-eaae-4b11-86fe-a1bd14e72806 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:46.739388 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-f531b82c-fcee-45d8-9fe9-32256d54f6be tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:46.747056 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f531b82c-fcee-45d8-9fe9-32256d54f6be tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1367 microversion: 2.1 time: 0.164683 Jun 28 03:22:46.757385 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 294/590] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:46 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:46.875834 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-49e6f53a-eaae-4b11-86fe-a1bd14e72806 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:46.884055 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-49e6f53a-eaae-4b11-86fe-a1bd14e72806 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1735 microversion: 2.1 time: 0.170338 Jun 28 03:22:46.884666 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 297/591] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:46 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:47.536652 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e2ce9f37-b6ea-4ddc-a31e-a6c4ca52f137 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:47.537250 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e2ce9f37-b6ea-4ddc-a31e-a6c4ca52f137 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:47.544956 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e2ce9f37-b6ea-4ddc-a31e-a6c4ca52f137 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:47.545362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e2ce9f37-b6ea-4ddc-a31e-a6c4ca52f137 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:47.546158 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e2ce9f37-b6ea-4ddc-a31e-a6c4ca52f137 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:47.546668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e2ce9f37-b6ea-4ddc-a31e-a6c4ca52f137 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:47.678513 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e2ce9f37-b6ea-4ddc-a31e-a6c4ca52f137 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:47.688622 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e2ce9f37-b6ea-4ddc-a31e-a6c4ca52f137 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:47.690966 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e2ce9f37-b6ea-4ddc-a31e-a6c4ca52f137 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:47.692954 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e2ce9f37-b6ea-4ddc-a31e-a6c4ca52f137 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1723 microversion: 2.20 time: 0.159854 Jun 28 03:22:47.693661 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 295/592] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:47 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:47.766732 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3b2c15f2-d64d-404b-b275-657c4079f871 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:47.767331 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3b2c15f2-d64d-404b-b275-657c4079f871 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:47.774304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3b2c15f2-d64d-404b-b275-657c4079f871 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:47.774769 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3b2c15f2-d64d-404b-b275-657c4079f871 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:47.775513 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3b2c15f2-d64d-404b-b275-657c4079f871 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:47.775936 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3b2c15f2-d64d-404b-b275-657c4079f871 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:47.903107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-51a39230-7462-4f0f-a44f-11892ec86146 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:47.903706 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-51a39230-7462-4f0f-a44f-11892ec86146 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:47.908745 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3b2c15f2-d64d-404b-b275-657c4079f871 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:47.910448 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-51a39230-7462-4f0f-a44f-11892ec86146 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:47.910896 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-51a39230-7462-4f0f-a44f-11892ec86146 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:47.911799 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-51a39230-7462-4f0f-a44f-11892ec86146 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:47.912588 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-51a39230-7462-4f0f-a44f-11892ec86146 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:47.916634 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3b2c15f2-d64d-404b-b275-657c4079f871 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1367 microversion: 2.1 time: 0.155129 Jun 28 03:22:47.917294 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 298/593] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:47 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:48.061842 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-51a39230-7462-4f0f-a44f-11892ec86146 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:48.073020 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-51a39230-7462-4f0f-a44f-11892ec86146 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1715 microversion: 2.1 time: 0.173632 Jun 28 03:22:48.073699 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 296/594] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:47 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1715 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:48.129725 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-516b3781-5dbd-4de8-820d-744c71bf1c55 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:48.130216 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-516b3781-5dbd-4de8-820d-744c71bf1c55 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:48.136708 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-516b3781-5dbd-4de8-820d-744c71bf1c55 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:48.137154 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-516b3781-5dbd-4de8-820d-744c71bf1c55 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:48.137912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-516b3781-5dbd-4de8-820d-744c71bf1c55 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:48.138342 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-516b3781-5dbd-4de8-820d-744c71bf1c55 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:48.229760 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-516b3781-5dbd-4de8-820d-744c71bf1c55 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] HTTP exception thrown: Cannot 'detach_volume' instance 88c49a8f-7779-4a9b-90dd-de3f851c517b while it is in vm_state rescued Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-516b3781-5dbd-4de8-820d-744c71bf1c55 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Request method failure captured: Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: DELETE /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-volume_attachments/cebc6dd4-8e1b-44f5-b9ae-2a3705a0874a HTTP/1.1 Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunM9Dd2r6ks5CIlIc9oHLOKluAAH5hNuDeG-EEwuyeKomrNFLTxgh-zrC0miKybndMxw9Cdi-BV0GgnKfutXJVMSeZgCSN-M0pbBhLprVRMibFfdu2RtmOFIDlDK49KX0XgdbKcGw2_LDDpApk_-py0nMs4uP1Q9olzEBrp7uDcYaAI Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: c1e596746cc64a1981804d95f1906bb3 Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:22:48.231636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:22:48.233293 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c1e596746cc64a1981804d95f1906bb3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:22:48.233293 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:22:48.233293 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: c1e596746cc64a1981804d95f1906bb3 Jun 28 03:22:48.233293 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:22:48.233293 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-ServerRescueNegativeTestJSON-1266345582-project Jun 28 03:22:48.233293 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:22:48.233293 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:22:48.233293 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: facb00bcd5644550a93901791f77b89c Jun 28 03:22:48.233293 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1266345582-project Jun 28 03:22:48.233293 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:22:48.233293 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Cannot 'detach_volume' instance 88c49a8f-7779-4a9b-90dd-de3f851c517b while it is in vm_state rescued Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'server_id': '88c49a8f-7779-4a9b-90dd-de3f851c517b', 'id': 'cebc6dd4-8e1b-44f5-b9ae-2a3705a0874a'} Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 88c49a8f-7779-4a9b-90dd-de3f851c517b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:22:48.234335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 88c49a8f-7779-4a9b-90dd-de3f851c517b while it is in vm_state rescued Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 88c49a8f-7779-4a9b-90dd-de3f851c517b while it is in vm_state rescued Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:22:48.235857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-516b3781-5dbd-4de8-820d-744c71bf1c55 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Returning 409 to user: Cannot 'detach_volume' instance 88c49a8f-7779-4a9b-90dd-de3f851c517b while it is in vm_state rescued {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:22:48.237173 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-516b3781-5dbd-4de8-820d-744c71bf1c55 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "DELETE /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-volume_attachments/cebc6dd4-8e1b-44f5-b9ae-2a3705a0874a" status: 409 len: 152 microversion: 2.1 time: 0.107810 Jun 28 03:22:48.237173 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 299/595] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 28 03:22:48 2022] DELETE /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-volume_attachments/cebc6dd4-8e1b-44f5-b9ae-2a3705a0874a => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 28 03:22:48.242306 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-0e424f63-33fb-4220-b80d-70af9e4e904c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:48.242855 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-0e424f63-33fb-4220-b80d-70af9e4e904c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:48.249090 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0e424f63-33fb-4220-b80d-70af9e4e904c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:48.249456 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0e424f63-33fb-4220-b80d-70af9e4e904c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:48.250441 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0e424f63-33fb-4220-b80d-70af9e4e904c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:48.250830 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0e424f63-33fb-4220-b80d-70af9e4e904c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:48.317984 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-0e424f63-33fb-4220-b80d-70af9e4e904c tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "POST /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/action" status: 202 len: 0 microversion: 2.1 time: 0.079436 Jun 28 03:22:48.318636 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 297/596] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:22:48 2022] POST /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:22:48.329970 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-87384af3-8fe5-4343-b5d7-4725de7978c0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:48.330575 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-87384af3-8fe5-4343-b5d7-4725de7978c0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:48.336992 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-87384af3-8fe5-4343-b5d7-4725de7978c0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:48.337441 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-87384af3-8fe5-4343-b5d7-4725de7978c0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:48.338193 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-87384af3-8fe5-4343-b5d7-4725de7978c0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:48.338625 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-87384af3-8fe5-4343-b5d7-4725de7978c0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:48.485477 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-87384af3-8fe5-4343-b5d7-4725de7978c0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:48.493784 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-87384af3-8fe5-4343-b5d7-4725de7978c0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1723 microversion: 2.1 time: 0.170078 Jun 28 03:22:48.494330 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 300/597] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:48 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:48.713871 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d4580c05-2f2a-4ce2-b9c0-8b41cea25f57 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:48.714528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d4580c05-2f2a-4ce2-b9c0-8b41cea25f57 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:48.721610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d4580c05-2f2a-4ce2-b9c0-8b41cea25f57 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:48.722049 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d4580c05-2f2a-4ce2-b9c0-8b41cea25f57 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:48.722800 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d4580c05-2f2a-4ce2-b9c0-8b41cea25f57 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:48.723224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d4580c05-2f2a-4ce2-b9c0-8b41cea25f57 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:48.853622 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d4580c05-2f2a-4ce2-b9c0-8b41cea25f57 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:48.862175 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d4580c05-2f2a-4ce2-b9c0-8b41cea25f57 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:48.863626 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d4580c05-2f2a-4ce2-b9c0-8b41cea25f57 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:48.864802 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d4580c05-2f2a-4ce2-b9c0-8b41cea25f57 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1723 microversion: 2.20 time: 0.155770 Jun 28 03:22:48.865347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 298/598] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:48 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:48.938897 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c9f90056-28ae-4cd9-863d-562de1093b8f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:48.939693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c9f90056-28ae-4cd9-863d-562de1093b8f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:48.946679 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c9f90056-28ae-4cd9-863d-562de1093b8f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:48.947119 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c9f90056-28ae-4cd9-863d-562de1093b8f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:48.947871 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c9f90056-28ae-4cd9-863d-562de1093b8f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:48.948327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c9f90056-28ae-4cd9-863d-562de1093b8f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:49.086061 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c9f90056-28ae-4cd9-863d-562de1093b8f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:49.096790 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c9f90056-28ae-4cd9-863d-562de1093b8f tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1367 microversion: 2.1 time: 0.165596 Jun 28 03:22:49.097329 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 301/599] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:48 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:49.511942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e77128a2-4173-4e30-ab32-3c6e9822e6d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:49.512609 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e77128a2-4173-4e30-ab32-3c6e9822e6d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:49.519273 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e77128a2-4173-4e30-ab32-3c6e9822e6d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:49.519716 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e77128a2-4173-4e30-ab32-3c6e9822e6d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:49.520500 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e77128a2-4173-4e30-ab32-3c6e9822e6d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:49.520924 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e77128a2-4173-4e30-ab32-3c6e9822e6d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:49.654639 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e77128a2-4173-4e30-ab32-3c6e9822e6d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:49.663064 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e77128a2-4173-4e30-ab32-3c6e9822e6d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1723 microversion: 2.1 time: 0.155852 Jun 28 03:22:49.663636 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 299/600] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:49 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:49.885394 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-19d96f28-3c77-4ba6-8baf-7af9efe5a56f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:49.886249 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-19d96f28-3c77-4ba6-8baf-7af9efe5a56f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:49.889023 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:49.894923 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-19d96f28-3c77-4ba6-8baf-7af9efe5a56f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:49.895357 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-19d96f28-3c77-4ba6-8baf-7af9efe5a56f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:49.896104 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-19d96f28-3c77-4ba6-8baf-7af9efe5a56f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:49.896557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-19d96f28-3c77-4ba6-8baf-7af9efe5a56f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:50.032553 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-19d96f28-3c77-4ba6-8baf-7af9efe5a56f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:50.040915 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-19d96f28-3c77-4ba6-8baf-7af9efe5a56f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:50.042377 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-19d96f28-3c77-4ba6-8baf-7af9efe5a56f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:50.043550 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-19d96f28-3c77-4ba6-8baf-7af9efe5a56f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1723 microversion: 2.20 time: 0.164223 Jun 28 03:22:50.044074 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 302/601] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:49 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:50.115857 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-dcc118c1-2897-4af6-9cf6-0036c1d33bcd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:50.116688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-dcc118c1-2897-4af6-9cf6-0036c1d33bcd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:50.125820 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dcc118c1-2897-4af6-9cf6-0036c1d33bcd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:50.126267 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dcc118c1-2897-4af6-9cf6-0036c1d33bcd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:50.127023 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dcc118c1-2897-4af6-9cf6-0036c1d33bcd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:50.127476 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dcc118c1-2897-4af6-9cf6-0036c1d33bcd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:50.267738 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-dcc118c1-2897-4af6-9cf6-0036c1d33bcd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:50.275480 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-dcc118c1-2897-4af6-9cf6-0036c1d33bcd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1367 microversion: 2.1 time: 0.165111 Jun 28 03:22:50.276210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 300/602] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:50 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:50.685053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-95ef3f8b-dc4d-4652-9398-1f142bddd1d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:50.686221 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-95ef3f8b-dc4d-4652-9398-1f142bddd1d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:50.696918 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95ef3f8b-dc4d-4652-9398-1f142bddd1d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:50.697648 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95ef3f8b-dc4d-4652-9398-1f142bddd1d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:50.698923 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95ef3f8b-dc4d-4652-9398-1f142bddd1d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:50.699586 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95ef3f8b-dc4d-4652-9398-1f142bddd1d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:50.833139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-95ef3f8b-dc4d-4652-9398-1f142bddd1d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:50.841245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-95ef3f8b-dc4d-4652-9398-1f142bddd1d0 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1723 microversion: 2.1 time: 0.162754 Jun 28 03:22:50.841810 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 303/603] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:50 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:51.062052 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b13880a8-9b5e-4bc5-9070-70a5b9dd1de7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:51.062659 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b13880a8-9b5e-4bc5-9070-70a5b9dd1de7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:51.069323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b13880a8-9b5e-4bc5-9070-70a5b9dd1de7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:51.069772 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b13880a8-9b5e-4bc5-9070-70a5b9dd1de7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:51.070519 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b13880a8-9b5e-4bc5-9070-70a5b9dd1de7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:51.070950 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b13880a8-9b5e-4bc5-9070-70a5b9dd1de7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:51.208199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b13880a8-9b5e-4bc5-9070-70a5b9dd1de7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:51.216516 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b13880a8-9b5e-4bc5-9070-70a5b9dd1de7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:51.217991 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b13880a8-9b5e-4bc5-9070-70a5b9dd1de7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:51.219210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b13880a8-9b5e-4bc5-9070-70a5b9dd1de7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1723 microversion: 2.20 time: 0.161100 Jun 28 03:22:51.220246 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 301/604] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:51 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:51.293313 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d9d10ce5-bd1b-41d9-8cf0-ead7decf0bd4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:51.293998 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d9d10ce5-bd1b-41d9-8cf0-ead7decf0bd4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:51.301080 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d9d10ce5-bd1b-41d9-8cf0-ead7decf0bd4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:51.301517 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d9d10ce5-bd1b-41d9-8cf0-ead7decf0bd4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:51.302297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d9d10ce5-bd1b-41d9-8cf0-ead7decf0bd4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:51.302724 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d9d10ce5-bd1b-41d9-8cf0-ead7decf0bd4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:51.455350 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d9d10ce5-bd1b-41d9-8cf0-ead7decf0bd4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:51.463364 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d9d10ce5-bd1b-41d9-8cf0-ead7decf0bd4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1367 microversion: 2.1 time: 0.174004 Jun 28 03:22:51.463909 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 304/605] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:51 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:51.783157 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-24028fc6-4bdf-4c78-a2ce-7913ffe54d68 req-759b85cd-fb7b-4ec8-b93e-93f8a7053553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb95203-3c4a-4225-9282-bd035696ef59", "name": "network-vif-plugged", "status": "completed", "tag": "cfd747c8-04ee-403a-8dcd-75a533cbca9e"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:51.787133 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:51.793568 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-24028fc6-4bdf-4c78-a2ce-7913ffe54d68 req-759b85cd-fb7b-4ec8-b93e-93f8a7053553 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:51.794270 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-24028fc6-4bdf-4c78-a2ce-7913ffe54d68 req-759b85cd-fb7b-4ec8-b93e-93f8a7053553 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:51.798530 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:51.810586 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-24028fc6-4bdf-4c78-a2ce-7913ffe54d68 req-759b85cd-fb7b-4ec8-b93e-93f8a7053553 service nova] Creating event network-vif-plugged:cfd747c8-04ee-403a-8dcd-75a533cbca9e for instance 0eb95203-3c4a-4225-9282-bd035696ef59 on hv-cinder-84684 Jun 28 03:22:51.816021 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-24028fc6-4bdf-4c78-a2ce-7913ffe54d68 req-759b85cd-fb7b-4ec8-b93e-93f8a7053553 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036923 Jun 28 03:22:51.816649 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 302/606] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:51.859824 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-302e6bd4-4e45-4a58-9427-f717ab422437 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:51.860491 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-302e6bd4-4e45-4a58-9427-f717ab422437 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:51.867584 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-302e6bd4-4e45-4a58-9427-f717ab422437 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:51.868026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-302e6bd4-4e45-4a58-9427-f717ab422437 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:51.868812 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-302e6bd4-4e45-4a58-9427-f717ab422437 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:51.869231 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-302e6bd4-4e45-4a58-9427-f717ab422437 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:52.010051 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-302e6bd4-4e45-4a58-9427-f717ab422437 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:52.018466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-302e6bd4-4e45-4a58-9427-f717ab422437 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1729 microversion: 2.1 time: 0.162470 Jun 28 03:22:52.019045 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 305/607] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:51 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:52.032469 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:52.037381 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c63483e6-0810-41f8-8dbf-37f2bf3aa61e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:52.037981 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c63483e6-0810-41f8-8dbf-37f2bf3aa61e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:52.045674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c63483e6-0810-41f8-8dbf-37f2bf3aa61e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:52.046115 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c63483e6-0810-41f8-8dbf-37f2bf3aa61e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:52.046969 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c63483e6-0810-41f8-8dbf-37f2bf3aa61e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:52.047396 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c63483e6-0810-41f8-8dbf-37f2bf3aa61e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:52.047830 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=6 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:52.138684 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c63483e6-0810-41f8-8dbf-37f2bf3aa61e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107562 Jun 28 03:22:52.139252 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 303/608] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 28 03:22:52 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:52.238148 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:52.302539 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-36e04021-6186-4dd7-8cab-96cdc8693675 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:52.303152 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-36e04021-6186-4dd7-8cab-96cdc8693675 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:52.309282 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-36e04021-6186-4dd7-8cab-96cdc8693675 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:52.309716 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-36e04021-6186-4dd7-8cab-96cdc8693675 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:52.310446 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-36e04021-6186-4dd7-8cab-96cdc8693675 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:52.311055 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-36e04021-6186-4dd7-8cab-96cdc8693675 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:52.442427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-36e04021-6186-4dd7-8cab-96cdc8693675 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:52.450569 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-36e04021-6186-4dd7-8cab-96cdc8693675 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:52.452108 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-36e04021-6186-4dd7-8cab-96cdc8693675 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:52.453369 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-36e04021-6186-4dd7-8cab-96cdc8693675 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1723 microversion: 2.20 time: 0.219881 Jun 28 03:22:52.454271 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 306/609] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:52 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:52.480756 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c3ce8104-3e13-45f9-a1a3-3f88fa57d047 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:52.481365 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c3ce8104-3e13-45f9-a1a3-3f88fa57d047 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:52.488175 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c3ce8104-3e13-45f9-a1a3-3f88fa57d047 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:52.488629 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c3ce8104-3e13-45f9-a1a3-3f88fa57d047 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:52.489398 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c3ce8104-3e13-45f9-a1a3-3f88fa57d047 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:52.489826 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c3ce8104-3e13-45f9-a1a3-3f88fa57d047 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:52.629131 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c3ce8104-3e13-45f9-a1a3-3f88fa57d047 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:52.637329 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c3ce8104-3e13-45f9-a1a3-3f88fa57d047 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1367 microversion: 2.1 time: 0.160729 Jun 28 03:22:52.638310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 304/610] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:52 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:53.472759 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b19f5a4c-798d-432f-a187-e833d00e0ab8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:53.473362 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b19f5a4c-798d-432f-a187-e833d00e0ab8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:53.477419 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-32b13163-3ec2-4832-a1e0-6da144e96f77 req-d7d56044-ab40-49fb-89f8-2ff148941b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c49a8f-7779-4a9b-90dd-de3f851c517b", "tag": "fdbb463e-d574-49cc-aabd-b6a74106c928"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:53.481040 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b19f5a4c-798d-432f-a187-e833d00e0ab8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:53.481822 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b19f5a4c-798d-432f-a187-e833d00e0ab8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:53.483446 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b19f5a4c-798d-432f-a187-e833d00e0ab8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:53.484217 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b19f5a4c-798d-432f-a187-e833d00e0ab8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:53.489291 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-32b13163-3ec2-4832-a1e0-6da144e96f77 req-d7d56044-ab40-49fb-89f8-2ff148941b55 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:53.489967 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-32b13163-3ec2-4832-a1e0-6da144e96f77 req-d7d56044-ab40-49fb-89f8-2ff148941b55 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:53.506196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-32b13163-3ec2-4832-a1e0-6da144e96f77 req-d7d56044-ab40-49fb-89f8-2ff148941b55 service nova] Creating event network-changed:fdbb463e-d574-49cc-aabd-b6a74106c928 for instance 88c49a8f-7779-4a9b-90dd-de3f851c517b on hv-cinder-84684 Jun 28 03:22:53.514405 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:22:53.518258 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-32b13163-3ec2-4832-a1e0-6da144e96f77 req-d7d56044-ab40-49fb-89f8-2ff148941b55 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045952 Jun 28 03:22:53.519141 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 305/611] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:53.630655 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b19f5a4c-798d-432f-a187-e833d00e0ab8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:53.638944 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b19f5a4c-798d-432f-a187-e833d00e0ab8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:53.641042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b19f5a4c-798d-432f-a187-e833d00e0ab8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:53.643134 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b19f5a4c-798d-432f-a187-e833d00e0ab8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1723 microversion: 2.20 time: 0.174110 Jun 28 03:22:53.643729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 307/612] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:53 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:53.660328 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-512cf0a2-a3a2-4f4f-8f1a-bd2f9d492742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:53.660951 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-512cf0a2-a3a2-4f4f-8f1a-bd2f9d492742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:53.667429 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-512cf0a2-a3a2-4f4f-8f1a-bd2f9d492742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:53.667936 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-512cf0a2-a3a2-4f4f-8f1a-bd2f9d492742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:53.668891 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-512cf0a2-a3a2-4f4f-8f1a-bd2f9d492742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:53.669432 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-512cf0a2-a3a2-4f4f-8f1a-bd2f9d492742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:53.810932 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-512cf0a2-a3a2-4f4f-8f1a-bd2f9d492742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:53.819351 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-512cf0a2-a3a2-4f4f-8f1a-bd2f9d492742 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1556 microversion: 2.1 time: 0.163927 Jun 28 03:22:53.819938 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 306/613] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:22:53 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:22:53.837773 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d174ff5c-004f-43bf-8d49-80820fac82b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:53.838630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d174ff5c-004f-43bf-8d49-80820fac82b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:53.847121 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d174ff5c-004f-43bf-8d49-80820fac82b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:53.847996 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d174ff5c-004f-43bf-8d49-80820fac82b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:53.849016 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d174ff5c-004f-43bf-8d49-80820fac82b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:53.850183 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d174ff5c-004f-43bf-8d49-80820fac82b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:53.937636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d174ff5c-004f-43bf-8d49-80820fac82b5 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105429 Jun 28 03:22:53.938421 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 308/614] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 28 03:22:53 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:54.660711 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-653e747d-5423-4bdd-a500-53025399023a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:54.661280 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-653e747d-5423-4bdd-a500-53025399023a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:54.668263 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-653e747d-5423-4bdd-a500-53025399023a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:54.668712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-653e747d-5423-4bdd-a500-53025399023a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:54.669476 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-653e747d-5423-4bdd-a500-53025399023a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:54.669909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-653e747d-5423-4bdd-a500-53025399023a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:54.894786 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-653e747d-5423-4bdd-a500-53025399023a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:54.903829 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-653e747d-5423-4bdd-a500-53025399023a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:54.905594 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-653e747d-5423-4bdd-a500-53025399023a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:54.906971 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-653e747d-5423-4bdd-a500-53025399023a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1744 microversion: 2.20 time: 0.250034 Jun 28 03:22:54.907566 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 307/615] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:54 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1744 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:55.000360 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-7f93f83d-b182-409a-a692-cf5b21366d91 req-b49fda1d-8dbf-4ece-91fd-90776e0e102a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb95203-3c4a-4225-9282-bd035696ef59", "tag": "cfd747c8-04ee-403a-8dcd-75a533cbca9e"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:55.009190 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-7f93f83d-b182-409a-a692-cf5b21366d91 req-b49fda1d-8dbf-4ece-91fd-90776e0e102a service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:55.009611 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-7f93f83d-b182-409a-a692-cf5b21366d91 req-b49fda1d-8dbf-4ece-91fd-90776e0e102a service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:55.020869 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-7f93f83d-b182-409a-a692-cf5b21366d91 req-b49fda1d-8dbf-4ece-91fd-90776e0e102a service nova] Creating event network-changed:cfd747c8-04ee-403a-8dcd-75a533cbca9e for instance 0eb95203-3c4a-4225-9282-bd035696ef59 on hv-cinder-84684 Jun 28 03:22:55.026157 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-7f93f83d-b182-409a-a692-cf5b21366d91 req-b49fda1d-8dbf-4ece-91fd-90776e0e102a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030099 Jun 28 03:22:55.026778 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 309/616] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:55.532257 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-ada2c565-bae9-49f8-9f35-e76dbb5c4401 req-0b4424ec-2f39-4f02-83d3-4a3212874342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c49a8f-7779-4a9b-90dd-de3f851c517b", "tag": "fdbb463e-d574-49cc-aabd-b6a74106c928"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:55.540739 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-ada2c565-bae9-49f8-9f35-e76dbb5c4401 req-0b4424ec-2f39-4f02-83d3-4a3212874342 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:55.541107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-ada2c565-bae9-49f8-9f35-e76dbb5c4401 req-0b4424ec-2f39-4f02-83d3-4a3212874342 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:55.552380 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-ada2c565-bae9-49f8-9f35-e76dbb5c4401 req-0b4424ec-2f39-4f02-83d3-4a3212874342 service nova] Creating event network-changed:fdbb463e-d574-49cc-aabd-b6a74106c928 for instance 88c49a8f-7779-4a9b-90dd-de3f851c517b on hv-cinder-84684 Jun 28 03:22:55.557630 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-ada2c565-bae9-49f8-9f35-e76dbb5c4401 req-0b4424ec-2f39-4f02-83d3-4a3212874342 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029240 Jun 28 03:22:55.558496 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 308/617] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:22:55.926564 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ecc927e1-a2d8-4095-a9eb-4cb2de61a5d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:55.927698 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ecc927e1-a2d8-4095-a9eb-4cb2de61a5d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:55.934325 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ecc927e1-a2d8-4095-a9eb-4cb2de61a5d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:55.934767 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ecc927e1-a2d8-4095-a9eb-4cb2de61a5d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:55.935531 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ecc927e1-a2d8-4095-a9eb-4cb2de61a5d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:55.936131 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ecc927e1-a2d8-4095-a9eb-4cb2de61a5d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:56.084552 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ecc927e1-a2d8-4095-a9eb-4cb2de61a5d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:56.094861 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ecc927e1-a2d8-4095-a9eb-4cb2de61a5d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:56.097358 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ecc927e1-a2d8-4095-a9eb-4cb2de61a5d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:56.098873 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ecc927e1-a2d8-4095-a9eb-4cb2de61a5d2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1744 microversion: 2.20 time: 0.176679 Jun 28 03:22:56.099743 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 310/618] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:55 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:57.120564 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-94d8d710-b95d-4b85-b1f7-242b7579e432 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:57.121598 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-94d8d710-b95d-4b85-b1f7-242b7579e432 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:57.129336 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-94d8d710-b95d-4b85-b1f7-242b7579e432 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:57.130036 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-94d8d710-b95d-4b85-b1f7-242b7579e432 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:57.131038 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-94d8d710-b95d-4b85-b1f7-242b7579e432 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:57.132222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-94d8d710-b95d-4b85-b1f7-242b7579e432 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:57.279023 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-94d8d710-b95d-4b85-b1f7-242b7579e432 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:57.290617 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-94d8d710-b95d-4b85-b1f7-242b7579e432 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:57.292223 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-94d8d710-b95d-4b85-b1f7-242b7579e432 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:57.293474 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-94d8d710-b95d-4b85-b1f7-242b7579e432 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1739 microversion: 2.20 time: 0.178621 Jun 28 03:22:57.294234 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 309/619] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:57 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:57.818728 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-a77976a4-f791-4b47-b624-625f91feff41 req-11e183e5-1c77-4606-824d-63689ef1bd4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e97b7a4-a1fb-4757-8d7f-d16a84c5561c", "name": "network-vif-plugged", "status": "completed", "tag": "02235355-6547-49bd-a247-cc3176e99f9e"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:22:57.833130 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a77976a4-f791-4b47-b624-625f91feff41 req-11e183e5-1c77-4606-824d-63689ef1bd4b service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:57.833785 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a77976a4-f791-4b47-b624-625f91feff41 req-11e183e5-1c77-4606-824d-63689ef1bd4b service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:57.846833 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-a77976a4-f791-4b47-b624-625f91feff41 req-11e183e5-1c77-4606-824d-63689ef1bd4b service nova] Creating event network-vif-plugged:02235355-6547-49bd-a247-cc3176e99f9e for instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c on hv-cinder-84684 Jun 28 03:22:57.852129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-a77976a4-f791-4b47-b624-625f91feff41 req-11e183e5-1c77-4606-824d-63689ef1bd4b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038254 Jun 28 03:22:57.852883 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 311/620] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:22:58.315068 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-456d096f-4a2b-4b68-a2fa-abeebc763054 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:58.316399 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-456d096f-4a2b-4b68-a2fa-abeebc763054 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:58.323283 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-456d096f-4a2b-4b68-a2fa-abeebc763054 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:58.323732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-456d096f-4a2b-4b68-a2fa-abeebc763054 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:58.324537 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-456d096f-4a2b-4b68-a2fa-abeebc763054 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:58.325092 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-456d096f-4a2b-4b68-a2fa-abeebc763054 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:58.484756 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-456d096f-4a2b-4b68-a2fa-abeebc763054 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:58.492703 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-456d096f-4a2b-4b68-a2fa-abeebc763054 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:58.494165 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-456d096f-4a2b-4b68-a2fa-abeebc763054 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:58.495728 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-456d096f-4a2b-4b68-a2fa-abeebc763054 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1739 microversion: 2.20 time: 0.188046 Jun 28 03:22:58.496482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 310/621] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:58 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:22:59.516094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-95a1458d-9ec9-45d2-ba10-f0d4def8f1ef tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:22:59.517607 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-95a1458d-9ec9-45d2-ba10-f0d4def8f1ef tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:22:59.524736 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95a1458d-9ec9-45d2-ba10-f0d4def8f1ef tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:59.525246 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95a1458d-9ec9-45d2-ba10-f0d4def8f1ef tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:59.526213 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95a1458d-9ec9-45d2-ba10-f0d4def8f1ef tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:22:59.526697 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95a1458d-9ec9-45d2-ba10-f0d4def8f1ef tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:22:59.669632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-95a1458d-9ec9-45d2-ba10-f0d4def8f1ef tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:59.678181 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-95a1458d-9ec9-45d2-ba10-f0d4def8f1ef tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:59.679894 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-95a1458d-9ec9-45d2-ba10-f0d4def8f1ef tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:22:59.681139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-95a1458d-9ec9-45d2-ba10-f0d4def8f1ef tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1739 microversion: 2.20 time: 0.169917 Jun 28 03:22:59.682179 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 312/622] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:22:59 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:00.699873 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a11a9426-3486-44ce-8b0b-f104feaf1ab5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:00.700443 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a11a9426-3486-44ce-8b0b-f104feaf1ab5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:00.708026 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a11a9426-3486-44ce-8b0b-f104feaf1ab5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:00.708713 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a11a9426-3486-44ce-8b0b-f104feaf1ab5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:00.709266 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a11a9426-3486-44ce-8b0b-f104feaf1ab5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:00.709734 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a11a9426-3486-44ce-8b0b-f104feaf1ab5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:00.846549 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a11a9426-3486-44ce-8b0b-f104feaf1ab5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:00.855465 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a11a9426-3486-44ce-8b0b-f104feaf1ab5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:00.857009 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a11a9426-3486-44ce-8b0b-f104feaf1ab5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:00.858195 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a11a9426-3486-44ce-8b0b-f104feaf1ab5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1739 microversion: 2.20 time: 0.162466 Jun 28 03:23:00.869333 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 311/623] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:00 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:01.408022 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2be88a2b-d4ac-450d-b648-cde80c3e2896 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:23:01.408861 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2be88a2b-d4ac-450d-b648-cde80c3e2896 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:01.416795 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2be88a2b-d4ac-450d-b648-cde80c3e2896 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:01.417332 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2be88a2b-d4ac-450d-b648-cde80c3e2896 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:01.418177 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2be88a2b-d4ac-450d-b648-cde80c3e2896 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:01.419085 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2be88a2b-d4ac-450d-b648-cde80c3e2896 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:01.443557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-2be88a2b-d4ac-450d-b648-cde80c3e2896 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lazy-loading 'flavor' on Instance uuid 18d20165-bd26-4933-9494-f57e12a4af62 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:23:01.528016 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2be88a2b-d4ac-450d-b648-cde80c3e2896 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "POST /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62/action" status: 202 len: 0 microversion: 2.1 time: 0.123919 Jun 28 03:23:01.529057 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 313/624] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:23:01 2022] POST /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:23:01.540211 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-52e845cd-20b9-4de4-8ee5-6b0144cebb44 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:01.540838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-52e845cd-20b9-4de4-8ee5-6b0144cebb44 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:01.550744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-52e845cd-20b9-4de4-8ee5-6b0144cebb44 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:01.551110 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-52e845cd-20b9-4de4-8ee5-6b0144cebb44 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:01.551891 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-52e845cd-20b9-4de4-8ee5-6b0144cebb44 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:01.552353 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-52e845cd-20b9-4de4-8ee5-6b0144cebb44 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:01.716064 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-52e845cd-20b9-4de4-8ee5-6b0144cebb44 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:01.724705 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-52e845cd-20b9-4de4-8ee5-6b0144cebb44 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.190967 Jun 28 03:23:01.725640 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 312/625] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:01 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:01.877219 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a857430b-5db9-4621-ae62-fabd5b4dd45a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:01.877912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a857430b-5db9-4621-ae62-fabd5b4dd45a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:01.884646 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a857430b-5db9-4621-ae62-fabd5b4dd45a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:01.885112 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a857430b-5db9-4621-ae62-fabd5b4dd45a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:01.885870 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a857430b-5db9-4621-ae62-fabd5b4dd45a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:01.886291 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a857430b-5db9-4621-ae62-fabd5b4dd45a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:02.047100 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a857430b-5db9-4621-ae62-fabd5b4dd45a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:02.055657 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a857430b-5db9-4621-ae62-fabd5b4dd45a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:02.058063 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a857430b-5db9-4621-ae62-fabd5b4dd45a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:02.059377 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a857430b-5db9-4621-ae62-fabd5b4dd45a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1739 microversion: 2.20 time: 0.186879 Jun 28 03:23:02.060416 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 314/626] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:01 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:02.749115 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-db7c68bf-888b-4e08-9fe1-fede518eb4a9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:02.750281 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-db7c68bf-888b-4e08-9fe1-fede518eb4a9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:02.758963 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-db7c68bf-888b-4e08-9fe1-fede518eb4a9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:02.759764 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-db7c68bf-888b-4e08-9fe1-fede518eb4a9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:02.760857 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-db7c68bf-888b-4e08-9fe1-fede518eb4a9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:02.761355 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-db7c68bf-888b-4e08-9fe1-fede518eb4a9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:02.915265 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-db7c68bf-888b-4e08-9fe1-fede518eb4a9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:02.927396 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-db7c68bf-888b-4e08-9fe1-fede518eb4a9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.184189 Jun 28 03:23:02.928222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 313/627] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:02 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:03.079834 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5168ab36-b101-4522-8941-ef2056a32763 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:03.081246 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5168ab36-b101-4522-8941-ef2056a32763 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:03.088495 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5168ab36-b101-4522-8941-ef2056a32763 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:03.089267 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5168ab36-b101-4522-8941-ef2056a32763 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:03.090348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5168ab36-b101-4522-8941-ef2056a32763 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:03.090965 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5168ab36-b101-4522-8941-ef2056a32763 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:03.238118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5168ab36-b101-4522-8941-ef2056a32763 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:03.255539 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5168ab36-b101-4522-8941-ef2056a32763 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:03.261197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5168ab36-b101-4522-8941-ef2056a32763 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:03.262414 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5168ab36-b101-4522-8941-ef2056a32763 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1739 microversion: 2.20 time: 0.187404 Jun 28 03:23:03.273230 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 315/628] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:03 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:03.945561 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ce4e333a-20c2-414d-930d-4f4d0eac6f1d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:03.946180 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ce4e333a-20c2-414d-930d-4f4d0eac6f1d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:03.953839 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ce4e333a-20c2-414d-930d-4f4d0eac6f1d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:03.953839 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ce4e333a-20c2-414d-930d-4f4d0eac6f1d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:03.955341 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ce4e333a-20c2-414d-930d-4f4d0eac6f1d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:03.955679 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ce4e333a-20c2-414d-930d-4f4d0eac6f1d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:04.107436 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ce4e333a-20c2-414d-930d-4f4d0eac6f1d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:04.115995 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ce4e333a-20c2-414d-930d-4f4d0eac6f1d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.174327 Jun 28 03:23:04.120227 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 314/629] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:03 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:04.285770 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-aa7ff1a5-b6bb-44ea-9420-eb446cb05a7a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:04.286488 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-aa7ff1a5-b6bb-44ea-9420-eb446cb05a7a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:04.293416 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aa7ff1a5-b6bb-44ea-9420-eb446cb05a7a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:04.293785 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aa7ff1a5-b6bb-44ea-9420-eb446cb05a7a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:04.294552 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aa7ff1a5-b6bb-44ea-9420-eb446cb05a7a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:04.295002 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aa7ff1a5-b6bb-44ea-9420-eb446cb05a7a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:04.447985 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-aa7ff1a5-b6bb-44ea-9420-eb446cb05a7a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:04.456404 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-aa7ff1a5-b6bb-44ea-9420-eb446cb05a7a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:04.457924 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-aa7ff1a5-b6bb-44ea-9420-eb446cb05a7a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:04.459093 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-aa7ff1a5-b6bb-44ea-9420-eb446cb05a7a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1739 microversion: 2.20 time: 0.182166 Jun 28 03:23:04.459845 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 316/630] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:04 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:05.133446 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-92d4e4d6-fa09-4d1a-bd25-2272b3402bf9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:05.134032 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-92d4e4d6-fa09-4d1a-bd25-2272b3402bf9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:05.141428 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-92d4e4d6-fa09-4d1a-bd25-2272b3402bf9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:05.141896 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-92d4e4d6-fa09-4d1a-bd25-2272b3402bf9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:05.142660 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-92d4e4d6-fa09-4d1a-bd25-2272b3402bf9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:05.143083 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-92d4e4d6-fa09-4d1a-bd25-2272b3402bf9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:05.278356 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-92d4e4d6-fa09-4d1a-bd25-2272b3402bf9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:05.285900 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-92d4e4d6-fa09-4d1a-bd25-2272b3402bf9 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.156461 Jun 28 03:23:05.292235 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 315/631] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:05 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:05.498401 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-543842e3-448f-461a-b7b2-129f9c59e224 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:05.499353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-543842e3-448f-461a-b7b2-129f9c59e224 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:05.510454 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-543842e3-448f-461a-b7b2-129f9c59e224 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:05.511183 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-543842e3-448f-461a-b7b2-129f9c59e224 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:05.512688 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-543842e3-448f-461a-b7b2-129f9c59e224 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:05.513427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-543842e3-448f-461a-b7b2-129f9c59e224 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:05.653206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-543842e3-448f-461a-b7b2-129f9c59e224 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:05.661996 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-543842e3-448f-461a-b7b2-129f9c59e224 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:05.663460 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-543842e3-448f-461a-b7b2-129f9c59e224 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:05.664640 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-543842e3-448f-461a-b7b2-129f9c59e224 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1739 microversion: 2.20 time: 0.172843 Jun 28 03:23:05.665203 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 317/632] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:05 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:06.305822 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8c106de5-32da-4675-9e22-d606cfd5682a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:06.306431 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-8c106de5-32da-4675-9e22-d606cfd5682a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:06.313732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c106de5-32da-4675-9e22-d606cfd5682a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:06.314184 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c106de5-32da-4675-9e22-d606cfd5682a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:06.314958 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c106de5-32da-4675-9e22-d606cfd5682a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:06.316241 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c106de5-32da-4675-9e22-d606cfd5682a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:06.448916 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-8c106de5-32da-4675-9e22-d606cfd5682a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:06.457190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-8c106de5-32da-4675-9e22-d606cfd5682a tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.155151 Jun 28 03:23:06.457739 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 316/633] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:06 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:06.687482 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-382c569e-879d-4195-8c1e-7b0185c626f5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:06.688524 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-382c569e-879d-4195-8c1e-7b0185c626f5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:06.695917 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-382c569e-879d-4195-8c1e-7b0185c626f5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:06.696396 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-382c569e-879d-4195-8c1e-7b0185c626f5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:06.697149 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-382c569e-879d-4195-8c1e-7b0185c626f5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:06.697579 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-382c569e-879d-4195-8c1e-7b0185c626f5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:06.835905 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-382c569e-879d-4195-8c1e-7b0185c626f5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:06.846032 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-382c569e-879d-4195-8c1e-7b0185c626f5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:06.847937 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-382c569e-879d-4195-8c1e-7b0185c626f5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:06.849110 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-382c569e-879d-4195-8c1e-7b0185c626f5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1721 microversion: 2.20 time: 0.168198 Jun 28 03:23:06.849673 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 318/634] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:06 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:07.478592 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-82270e5b-a5b3-4197-8546-7b1b06089132 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:07.479964 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-82270e5b-a5b3-4197-8546-7b1b06089132 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:07.491179 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-82270e5b-a5b3-4197-8546-7b1b06089132 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:07.491899 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-82270e5b-a5b3-4197-8546-7b1b06089132 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:07.493230 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-82270e5b-a5b3-4197-8546-7b1b06089132 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:07.494005 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-82270e5b-a5b3-4197-8546-7b1b06089132 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:07.637594 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-82270e5b-a5b3-4197-8546-7b1b06089132 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:07.645779 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-82270e5b-a5b3-4197-8546-7b1b06089132 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.173773 Jun 28 03:23:07.646315 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 317/635] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:07 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:07.870018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a282aa27-cc3e-476c-8f9f-b4e4a7fee2be tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:07.870807 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a282aa27-cc3e-476c-8f9f-b4e4a7fee2be tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:07.878991 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a282aa27-cc3e-476c-8f9f-b4e4a7fee2be tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:07.879580 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a282aa27-cc3e-476c-8f9f-b4e4a7fee2be tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:07.880625 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a282aa27-cc3e-476c-8f9f-b4e4a7fee2be tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:07.881199 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a282aa27-cc3e-476c-8f9f-b4e4a7fee2be tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:08.013713 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a282aa27-cc3e-476c-8f9f-b4e4a7fee2be tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:08.022166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a282aa27-cc3e-476c-8f9f-b4e4a7fee2be tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:08.023637 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a282aa27-cc3e-476c-8f9f-b4e4a7fee2be tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:08.024818 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a282aa27-cc3e-476c-8f9f-b4e4a7fee2be tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1721 microversion: 2.20 time: 0.160121 Jun 28 03:23:08.025388 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 319/636] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:07 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:08.667028 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c7da5e8c-7461-435d-9819-bbe146c8e2c6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:08.668013 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c7da5e8c-7461-435d-9819-bbe146c8e2c6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:08.677747 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7da5e8c-7461-435d-9819-bbe146c8e2c6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:08.678191 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7da5e8c-7461-435d-9819-bbe146c8e2c6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:08.678946 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7da5e8c-7461-435d-9819-bbe146c8e2c6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:08.679371 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7da5e8c-7461-435d-9819-bbe146c8e2c6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:08.824627 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c7da5e8c-7461-435d-9819-bbe146c8e2c6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:08.832905 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c7da5e8c-7461-435d-9819-bbe146c8e2c6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.172347 Jun 28 03:23:08.833477 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 318/637] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:08 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:09.043785 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-38f236a7-65ff-4d7f-ab0c-8b588421a449 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:09.044422 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-38f236a7-65ff-4d7f-ab0c-8b588421a449 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:09.051976 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-38f236a7-65ff-4d7f-ab0c-8b588421a449 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:09.052471 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-38f236a7-65ff-4d7f-ab0c-8b588421a449 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:09.053262 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-38f236a7-65ff-4d7f-ab0c-8b588421a449 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:09.053722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-38f236a7-65ff-4d7f-ab0c-8b588421a449 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:09.191631 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-38f236a7-65ff-4d7f-ab0c-8b588421a449 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:09.204222 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-38f236a7-65ff-4d7f-ab0c-8b588421a449 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:09.206596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-38f236a7-65ff-4d7f-ab0c-8b588421a449 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:09.207930 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-38f236a7-65ff-4d7f-ab0c-8b588421a449 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1664 microversion: 2.20 time: 0.168577 Jun 28 03:23:09.208525 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 320/638] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:09 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:09.228445 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7f0ceb58-e786-49de-8020-270931d93f22 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a30f7560-4b28-460a-b948-a2e5f703a2dc"}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:23:09.230405 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7f0ceb58-e786-49de-8020-270931d93f22 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:09.238992 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7f0ceb58-e786-49de-8020-270931d93f22 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:09.239430 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7f0ceb58-e786-49de-8020-270931d93f22 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:09.240185 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7f0ceb58-e786-49de-8020-270931d93f22 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:09.240640 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7f0ceb58-e786-49de-8020-270931d93f22 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:09.448274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:09.558448 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7f0ceb58-e786-49de-8020-270931d93f22 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "POST /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.336486 Jun 28 03:23:09.558975 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 319/639] 10.222.0.44 () {62 vars in 1363 bytes} [Tue Jun 28 03:23:09 2022] POST /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/os-volume_attachments => generated 188 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 28 03:23:09.671961 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b6f49300-51a7-4d85-af42-0bfa84e9840a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:09.672478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b6f49300-51a7-4d85-af42-0bfa84e9840a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:09.679097 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b6f49300-51a7-4d85-af42-0bfa84e9840a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:09.679542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b6f49300-51a7-4d85-af42-0bfa84e9840a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:09.680369 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b6f49300-51a7-4d85-af42-0bfa84e9840a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:09.680798 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b6f49300-51a7-4d85-af42-0bfa84e9840a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:09.837388 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-86277331-13b0-46c0-8217-1b1fdffdcdfd req-d2ad24b1-865e-4173-9773-308f7af59ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e97b7a4-a1fb-4757-8d7f-d16a84c5561c", "name": "network-vif-unplugged", "status": "completed", "tag": "02235355-6547-49bd-a247-cc3176e99f9e"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:23:09.850771 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-86277331-13b0-46c0-8217-1b1fdffdcdfd req-d2ad24b1-865e-4173-9773-308f7af59ceb service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:09.851527 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-86277331-13b0-46c0-8217-1b1fdffdcdfd req-d2ad24b1-865e-4173-9773-308f7af59ceb service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:09.871258 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.compute.server_external_events [req-86277331-13b0-46c0-8217-1b1fdffdcdfd req-d2ad24b1-865e-4173-9773-308f7af59ceb service nova] Unable to find a host for instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c. Dropping event network-vif-unplugged {{(pid=117681) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 28 03:23:09.872867 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-86277331-13b0-46c0-8217-1b1fdffdcdfd req-d2ad24b1-865e-4173-9773-308f7af59ceb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039963 Jun 28 03:23:09.874070 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 320/640] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 28 03:23:09.882127 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-764df81e-228f-46f1-8e75-aa9744fafeb7 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:09.883209 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-764df81e-228f-46f1-8e75-aa9744fafeb7 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:09.891745 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-764df81e-228f-46f1-8e75-aa9744fafeb7 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:09.892377 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-764df81e-228f-46f1-8e75-aa9744fafeb7 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:09.893302 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-764df81e-228f-46f1-8e75-aa9744fafeb7 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:09.894289 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-764df81e-228f-46f1-8e75-aa9744fafeb7 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:09.947875 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:09.952410 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b6f49300-51a7-4d85-af42-0bfa84e9840a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/os-volume_attachments/a30f7560-4b28-460a-b948-a2e5f703a2dc" status: 202 len: 0 microversion: 2.20 time: 0.284362 Jun 28 03:23:09.953651 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 321/641] 10.222.0.44 () {60 vars in 1456 bytes} [Tue Jun 28 03:23:09 2022] DELETE /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/os-volume_attachments/a30f7560-4b28-460a-b948-a2e5f703a2dc => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:23:10.013028 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2ac66da9-88f0-4823-9dd2-19e65696f3aa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:23:10.013888 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2ac66da9-88f0-4823-9dd2-19e65696f3aa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:10.021306 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2ac66da9-88f0-4823-9dd2-19e65696f3aa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:10.021744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2ac66da9-88f0-4823-9dd2-19e65696f3aa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:10.022499 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2ac66da9-88f0-4823-9dd2-19e65696f3aa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:10.022925 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2ac66da9-88f0-4823-9dd2-19e65696f3aa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:10.035683 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-764df81e-228f-46f1-8e75-aa9744fafeb7 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:10.043717 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-764df81e-228f-46f1-8e75-aa9744fafeb7 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.168430 Jun 28 03:23:10.044316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 321/642] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:09 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:10.106921 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2ac66da9-88f0-4823-9dd2-19e65696f3aa tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "POST /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/action" status: 202 len: 0 microversion: 2.20 time: 0.097880 Jun 28 03:23:10.107758 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 322/643] 10.222.0.44 () {62 vars in 1318 bytes} [Tue Jun 28 03:23:10 2022] POST /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:23:10.115896 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-809fe8c2-fa66-4288-b672-39956c8378e3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:10.116526 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-809fe8c2-fa66-4288-b672-39956c8378e3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:10.122594 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-809fe8c2-fa66-4288-b672-39956c8378e3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:10.123033 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-809fe8c2-fa66-4288-b672-39956c8378e3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:10.123785 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-809fe8c2-fa66-4288-b672-39956c8378e3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:10.124246 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-809fe8c2-fa66-4288-b672-39956c8378e3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:10.257099 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-809fe8c2-fa66-4288-b672-39956c8378e3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:10.265078 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-809fe8c2-fa66-4288-b672-39956c8378e3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:10.266526 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-809fe8c2-fa66-4288-b672-39956c8378e3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:10.267669 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-809fe8c2-fa66-4288-b672-39956c8378e3 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1672 microversion: 2.20 time: 0.155926 Jun 28 03:23:10.268255 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 322/644] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:10 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:23:11.061090 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b1b39791-1297-4bf1-93b2-82dac68a9273 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:11.061766 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b1b39791-1297-4bf1-93b2-82dac68a9273 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:11.068329 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1b39791-1297-4bf1-93b2-82dac68a9273 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:11.068768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1b39791-1297-4bf1-93b2-82dac68a9273 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:11.069495 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1b39791-1297-4bf1-93b2-82dac68a9273 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:11.070155 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1b39791-1297-4bf1-93b2-82dac68a9273 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:11.204486 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b1b39791-1297-4bf1-93b2-82dac68a9273 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:11.216820 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b1b39791-1297-4bf1-93b2-82dac68a9273 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.159889 Jun 28 03:23:11.217620 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 323/645] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:11 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:11.286395 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7c484cc3-8dad-46cb-803d-c36c9d8a1ebd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:11.286984 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7c484cc3-8dad-46cb-803d-c36c9d8a1ebd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:11.293910 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7c484cc3-8dad-46cb-803d-c36c9d8a1ebd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:11.294351 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7c484cc3-8dad-46cb-803d-c36c9d8a1ebd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:11.295103 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7c484cc3-8dad-46cb-803d-c36c9d8a1ebd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:11.295531 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7c484cc3-8dad-46cb-803d-c36c9d8a1ebd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:11.439097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7c484cc3-8dad-46cb-803d-c36c9d8a1ebd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:11.448176 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7c484cc3-8dad-46cb-803d-c36c9d8a1ebd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:11.449647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7c484cc3-8dad-46cb-803d-c36c9d8a1ebd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:11.450806 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7c484cc3-8dad-46cb-803d-c36c9d8a1ebd tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.168514 Jun 28 03:23:11.451347 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 323/646] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:11 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:12.236195 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2c0e0467-b75f-4a19-a413-22e1447b18ed tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:12.237341 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2c0e0467-b75f-4a19-a413-22e1447b18ed tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:12.244462 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2c0e0467-b75f-4a19-a413-22e1447b18ed tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:12.244906 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2c0e0467-b75f-4a19-a413-22e1447b18ed tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:12.245655 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2c0e0467-b75f-4a19-a413-22e1447b18ed tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:12.246047 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2c0e0467-b75f-4a19-a413-22e1447b18ed tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:12.441691 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2c0e0467-b75f-4a19-a413-22e1447b18ed tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:12.450002 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2c0e0467-b75f-4a19-a413-22e1447b18ed tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.217580 Jun 28 03:23:12.453402 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 324/647] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:12 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:12.469428 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-1b5c146f-78d9-48ec-b403-817a5d89b51a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:12.470199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-1b5c146f-78d9-48ec-b403-817a5d89b51a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:12.478330 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1b5c146f-78d9-48ec-b403-817a5d89b51a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:12.478770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1b5c146f-78d9-48ec-b403-817a5d89b51a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:12.479864 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1b5c146f-78d9-48ec-b403-817a5d89b51a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:12.480319 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1b5c146f-78d9-48ec-b403-817a5d89b51a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:12.898649 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-1b5c146f-78d9-48ec-b403-817a5d89b51a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:12.910389 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-1b5c146f-78d9-48ec-b403-817a5d89b51a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:12.911867 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-1b5c146f-78d9-48ec-b403-817a5d89b51a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:12.913027 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-1b5c146f-78d9-48ec-b403-817a5d89b51a tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.447454 Jun 28 03:23:12.913583 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 324/648] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:12 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:13.468014 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-29c66fb6-da70-4406-8d53-22a6b9460d29 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:13.468691 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-29c66fb6-da70-4406-8d53-22a6b9460d29 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:13.475995 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-29c66fb6-da70-4406-8d53-22a6b9460d29 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:13.476468 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-29c66fb6-da70-4406-8d53-22a6b9460d29 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:13.477216 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-29c66fb6-da70-4406-8d53-22a6b9460d29 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:13.477672 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-29c66fb6-da70-4406-8d53-22a6b9460d29 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:13.616092 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-29c66fb6-da70-4406-8d53-22a6b9460d29 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:13.624311 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-29c66fb6-da70-4406-8d53-22a6b9460d29 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.160691 Jun 28 03:23:13.624879 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 325/649] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:13 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:13.931544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7cbd3fc7-0488-4e63-b512-90d3f2b254e2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:13.932387 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7cbd3fc7-0488-4e63-b512-90d3f2b254e2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:13.939328 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7cbd3fc7-0488-4e63-b512-90d3f2b254e2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:13.939861 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7cbd3fc7-0488-4e63-b512-90d3f2b254e2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:13.940722 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7cbd3fc7-0488-4e63-b512-90d3f2b254e2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:13.941226 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7cbd3fc7-0488-4e63-b512-90d3f2b254e2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:14.079574 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7cbd3fc7-0488-4e63-b512-90d3f2b254e2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:14.087772 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7cbd3fc7-0488-4e63-b512-90d3f2b254e2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:14.089350 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7cbd3fc7-0488-4e63-b512-90d3f2b254e2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:14.090666 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7cbd3fc7-0488-4e63-b512-90d3f2b254e2 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.163307 Jun 28 03:23:14.091236 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 325/650] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:13 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:14.641609 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-84e4b6e0-d5aa-4354-90f8-d5e9d20f4039 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:14.642218 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-84e4b6e0-d5aa-4354-90f8-d5e9d20f4039 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:14.650309 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-84e4b6e0-d5aa-4354-90f8-d5e9d20f4039 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:14.650861 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-84e4b6e0-d5aa-4354-90f8-d5e9d20f4039 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:14.651679 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-84e4b6e0-d5aa-4354-90f8-d5e9d20f4039 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:14.652231 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-84e4b6e0-d5aa-4354-90f8-d5e9d20f4039 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:14.816749 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-84e4b6e0-d5aa-4354-90f8-d5e9d20f4039 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:14.826107 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-84e4b6e0-d5aa-4354-90f8-d5e9d20f4039 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.188404 Jun 28 03:23:14.827184 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 326/651] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:14 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:15.110802 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4547cae5-2dd9-4f1d-bd30-310cef96a010 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:15.111375 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4547cae5-2dd9-4f1d-bd30-310cef96a010 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:15.118269 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4547cae5-2dd9-4f1d-bd30-310cef96a010 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:15.118710 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4547cae5-2dd9-4f1d-bd30-310cef96a010 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:15.119499 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4547cae5-2dd9-4f1d-bd30-310cef96a010 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:15.119922 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4547cae5-2dd9-4f1d-bd30-310cef96a010 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:15.262595 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4547cae5-2dd9-4f1d-bd30-310cef96a010 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:15.271231 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4547cae5-2dd9-4f1d-bd30-310cef96a010 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:15.273121 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4547cae5-2dd9-4f1d-bd30-310cef96a010 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:15.274586 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4547cae5-2dd9-4f1d-bd30-310cef96a010 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.167952 Jun 28 03:23:15.275218 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 326/652] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:15 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:15.843026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a95bf780-b43b-4916-8497-116186ab4383 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:15.843605 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a95bf780-b43b-4916-8497-116186ab4383 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:15.850746 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a95bf780-b43b-4916-8497-116186ab4383 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:15.851357 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a95bf780-b43b-4916-8497-116186ab4383 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:15.852709 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a95bf780-b43b-4916-8497-116186ab4383 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:15.853349 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a95bf780-b43b-4916-8497-116186ab4383 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:16.016849 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a95bf780-b43b-4916-8497-116186ab4383 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:16.025258 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a95bf780-b43b-4916-8497-116186ab4383 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.186075 Jun 28 03:23:16.025843 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 327/653] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:15 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:16.293085 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b17abd88-220c-4196-b569-88f0ed19a9e7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:16.293689 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b17abd88-220c-4196-b569-88f0ed19a9e7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:16.300701 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b17abd88-220c-4196-b569-88f0ed19a9e7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:16.301143 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b17abd88-220c-4196-b569-88f0ed19a9e7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:16.301905 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b17abd88-220c-4196-b569-88f0ed19a9e7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:16.302331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b17abd88-220c-4196-b569-88f0ed19a9e7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:16.441302 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b17abd88-220c-4196-b569-88f0ed19a9e7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:16.449940 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b17abd88-220c-4196-b569-88f0ed19a9e7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:16.451447 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b17abd88-220c-4196-b569-88f0ed19a9e7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:16.452684 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b17abd88-220c-4196-b569-88f0ed19a9e7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.163847 Jun 28 03:23:16.453241 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 327/654] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:16 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:17.045303 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3643dcc0-1ae6-47c5-9e3f-2b89464274f0 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:17.046717 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3643dcc0-1ae6-47c5-9e3f-2b89464274f0 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:17.055577 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3643dcc0-1ae6-47c5-9e3f-2b89464274f0 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:17.056014 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3643dcc0-1ae6-47c5-9e3f-2b89464274f0 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:17.056811 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3643dcc0-1ae6-47c5-9e3f-2b89464274f0 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:17.057236 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3643dcc0-1ae6-47c5-9e3f-2b89464274f0 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:17.199104 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3643dcc0-1ae6-47c5-9e3f-2b89464274f0 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:17.207117 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3643dcc0-1ae6-47c5-9e3f-2b89464274f0 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.167909 Jun 28 03:23:17.208096 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 328/655] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:17 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:17.471664 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b18b8abe-0d32-4f5f-ab9f-5357b841e956 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:17.472367 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b18b8abe-0d32-4f5f-ab9f-5357b841e956 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:17.479497 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b18b8abe-0d32-4f5f-ab9f-5357b841e956 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:17.480086 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b18b8abe-0d32-4f5f-ab9f-5357b841e956 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:17.480953 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b18b8abe-0d32-4f5f-ab9f-5357b841e956 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:17.481454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b18b8abe-0d32-4f5f-ab9f-5357b841e956 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:17.622558 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b18b8abe-0d32-4f5f-ab9f-5357b841e956 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:17.632106 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b18b8abe-0d32-4f5f-ab9f-5357b841e956 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:17.633610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b18b8abe-0d32-4f5f-ab9f-5357b841e956 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:17.635051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b18b8abe-0d32-4f5f-ab9f-5357b841e956 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.167789 Jun 28 03:23:17.635915 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 328/656] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:17 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:17.895170 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-a4579ab8-216f-43c4-aea8-ed8bd80db4d1 req-3e4aaa3f-0b75-4f8c-ba5c-b5bd662d9ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d20165-bd26-4933-9494-f57e12a4af62", "name": "network-vif-unplugged", "status": "completed", "tag": "5ef0c0c3-3a01-4e07-9e58-af12fe750d01"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:23:17.904684 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a4579ab8-216f-43c4-aea8-ed8bd80db4d1 req-3e4aaa3f-0b75-4f8c-ba5c-b5bd662d9ce1 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:17.905164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a4579ab8-216f-43c4-aea8-ed8bd80db4d1 req-3e4aaa3f-0b75-4f8c-ba5c-b5bd662d9ce1 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:17.917662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-a4579ab8-216f-43c4-aea8-ed8bd80db4d1 req-3e4aaa3f-0b75-4f8c-ba5c-b5bd662d9ce1 service nova] Creating event network-vif-unplugged:5ef0c0c3-3a01-4e07-9e58-af12fe750d01 for instance 18d20165-bd26-4933-9494-f57e12a4af62 on hv-cinder-84684 Jun 28 03:23:17.925119 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-a4579ab8-216f-43c4-aea8-ed8bd80db4d1 req-3e4aaa3f-0b75-4f8c-ba5c-b5bd662d9ce1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033327 Jun 28 03:23:17.926574 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 329/657] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:23:18.226608 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a6784b22-ab4d-48c3-a172-9dcf8d2af2d2 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:18.227615 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a6784b22-ab4d-48c3-a172-9dcf8d2af2d2 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:18.234439 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a6784b22-ab4d-48c3-a172-9dcf8d2af2d2 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:18.234879 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a6784b22-ab4d-48c3-a172-9dcf8d2af2d2 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:18.235663 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a6784b22-ab4d-48c3-a172-9dcf8d2af2d2 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:18.236087 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a6784b22-ab4d-48c3-a172-9dcf8d2af2d2 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:18.378476 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a6784b22-ab4d-48c3-a172-9dcf8d2af2d2 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:18.386397 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a6784b22-ab4d-48c3-a172-9dcf8d2af2d2 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.164179 Jun 28 03:23:18.386965 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 329/658] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:18 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:18.656430 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fd04ff45-0f35-407b-a7dc-1695a22e1d29 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:18.657879 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fd04ff45-0f35-407b-a7dc-1695a22e1d29 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:18.665197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd04ff45-0f35-407b-a7dc-1695a22e1d29 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:18.665670 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd04ff45-0f35-407b-a7dc-1695a22e1d29 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:18.666463 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd04ff45-0f35-407b-a7dc-1695a22e1d29 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:18.666895 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd04ff45-0f35-407b-a7dc-1695a22e1d29 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:18.810029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fd04ff45-0f35-407b-a7dc-1695a22e1d29 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:18.819258 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fd04ff45-0f35-407b-a7dc-1695a22e1d29 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:18.821546 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fd04ff45-0f35-407b-a7dc-1695a22e1d29 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:18.823161 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fd04ff45-0f35-407b-a7dc-1695a22e1d29 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.171632 Jun 28 03:23:18.823723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 330/659] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:18 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:19.403358 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-149ead65-e04a-4220-bba5-bda3b2428500 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:19.403924 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-149ead65-e04a-4220-bba5-bda3b2428500 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:19.410938 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-149ead65-e04a-4220-bba5-bda3b2428500 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:19.411389 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-149ead65-e04a-4220-bba5-bda3b2428500 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:19.412221 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-149ead65-e04a-4220-bba5-bda3b2428500 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:19.412661 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-149ead65-e04a-4220-bba5-bda3b2428500 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:19.581059 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-149ead65-e04a-4220-bba5-bda3b2428500 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:19.591357 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-149ead65-e04a-4220-bba5-bda3b2428500 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.191778 Jun 28 03:23:19.592184 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 330/660] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:19 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:19.845518 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5446fba7-42f8-44e6-9b86-113f09946fc5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:19.846359 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5446fba7-42f8-44e6-9b86-113f09946fc5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:19.853095 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5446fba7-42f8-44e6-9b86-113f09946fc5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:19.853602 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5446fba7-42f8-44e6-9b86-113f09946fc5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:19.854767 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5446fba7-42f8-44e6-9b86-113f09946fc5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:19.855195 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5446fba7-42f8-44e6-9b86-113f09946fc5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:20.008086 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5446fba7-42f8-44e6-9b86-113f09946fc5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:20.016954 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5446fba7-42f8-44e6-9b86-113f09946fc5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:20.018427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5446fba7-42f8-44e6-9b86-113f09946fc5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:20.019595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5446fba7-42f8-44e6-9b86-113f09946fc5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.178589 Jun 28 03:23:20.030208 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 331/661] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:19 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:23:20.614250 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c0f1b6e4-dd80-4713-b567-1c2cbf50bce3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:20.614250 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c0f1b6e4-dd80-4713-b567-1c2cbf50bce3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:20.629503 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c0f1b6e4-dd80-4713-b567-1c2cbf50bce3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:20.629929 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c0f1b6e4-dd80-4713-b567-1c2cbf50bce3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:20.630773 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c0f1b6e4-dd80-4713-b567-1c2cbf50bce3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:20.631264 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c0f1b6e4-dd80-4713-b567-1c2cbf50bce3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:20.783514 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c0f1b6e4-dd80-4713-b567-1c2cbf50bce3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:20.791492 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c0f1b6e4-dd80-4713-b567-1c2cbf50bce3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.185737 Jun 28 03:23:20.792060 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 331/662] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:20 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:21.039721 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-95e89f4f-1637-40d4-bbd4-511345def5b7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:21.041211 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-95e89f4f-1637-40d4-bbd4-511345def5b7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:21.044184 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=62 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:21.050433 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95e89f4f-1637-40d4-bbd4-511345def5b7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:21.051097 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95e89f4f-1637-40d4-bbd4-511345def5b7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:21.051860 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95e89f4f-1637-40d4-bbd4-511345def5b7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:21.052340 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95e89f4f-1637-40d4-bbd4-511345def5b7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:21.211628 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-95e89f4f-1637-40d4-bbd4-511345def5b7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:21.220780 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-95e89f4f-1637-40d4-bbd4-511345def5b7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:21.222534 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-95e89f4f-1637-40d4-bbd4-511345def5b7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:21.223685 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-95e89f4f-1637-40d4-bbd4-511345def5b7 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.188152 Jun 28 03:23:21.224269 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 332/663] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:21 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:21.809069 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2f7fa2fc-2c11-491e-945e-ca77b04deb86 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:21.809788 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2f7fa2fc-2c11-491e-945e-ca77b04deb86 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:21.817597 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2f7fa2fc-2c11-491e-945e-ca77b04deb86 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:21.818087 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2f7fa2fc-2c11-491e-945e-ca77b04deb86 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:21.818969 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2f7fa2fc-2c11-491e-945e-ca77b04deb86 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:21.819403 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2f7fa2fc-2c11-491e-945e-ca77b04deb86 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:21.958553 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2f7fa2fc-2c11-491e-945e-ca77b04deb86 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:21.972440 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2f7fa2fc-2c11-491e-945e-ca77b04deb86 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.166928 Jun 28 03:23:21.973219 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 332/664] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:21 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:22.247235 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2ef58664-0cfc-4bf3-8fa2-fe5aeb1e0429 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:22.248249 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2ef58664-0cfc-4bf3-8fa2-fe5aeb1e0429 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:22.259978 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2ef58664-0cfc-4bf3-8fa2-fe5aeb1e0429 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:22.260761 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2ef58664-0cfc-4bf3-8fa2-fe5aeb1e0429 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:22.262004 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2ef58664-0cfc-4bf3-8fa2-fe5aeb1e0429 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:22.262708 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2ef58664-0cfc-4bf3-8fa2-fe5aeb1e0429 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:22.403386 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2ef58664-0cfc-4bf3-8fa2-fe5aeb1e0429 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:22.412086 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2ef58664-0cfc-4bf3-8fa2-fe5aeb1e0429 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:22.413802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2ef58664-0cfc-4bf3-8fa2-fe5aeb1e0429 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:22.415016 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2ef58664-0cfc-4bf3-8fa2-fe5aeb1e0429 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.174766 Jun 28 03:23:22.415566 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 333/665] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:22 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:22.994776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-479340cc-0691-4fc1-b5c2-e3090ed8edac tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:22.995659 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-479340cc-0691-4fc1-b5c2-e3090ed8edac tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:22.999415 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=62 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:23.008994 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-479340cc-0691-4fc1-b5c2-e3090ed8edac tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:23.009732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-479340cc-0691-4fc1-b5c2-e3090ed8edac tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:23.010985 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-479340cc-0691-4fc1-b5c2-e3090ed8edac tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:23.011694 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-479340cc-0691-4fc1-b5c2-e3090ed8edac tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:23.155893 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-479340cc-0691-4fc1-b5c2-e3090ed8edac tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:23.164143 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-479340cc-0691-4fc1-b5c2-e3090ed8edac tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.175884 Jun 28 03:23:23.164906 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 333/666] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:22 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:23.440458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4142a1be-c33f-4049-a8dc-fcbbee77140b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:23.441412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4142a1be-c33f-4049-a8dc-fcbbee77140b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:23.449921 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4142a1be-c33f-4049-a8dc-fcbbee77140b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:23.450363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4142a1be-c33f-4049-a8dc-fcbbee77140b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:23.451145 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4142a1be-c33f-4049-a8dc-fcbbee77140b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:23.451570 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4142a1be-c33f-4049-a8dc-fcbbee77140b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:23.598621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4142a1be-c33f-4049-a8dc-fcbbee77140b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:23.606931 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4142a1be-c33f-4049-a8dc-fcbbee77140b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:23.608435 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4142a1be-c33f-4049-a8dc-fcbbee77140b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:23.609585 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4142a1be-c33f-4049-a8dc-fcbbee77140b tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.175848 Jun 28 03:23:23.610143 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 334/667] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:23 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:24.185975 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-82cbfd68-4b0a-4926-9d80-dc6693183ec3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:24.186974 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-82cbfd68-4b0a-4926-9d80-dc6693183ec3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:24.197174 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-82cbfd68-4b0a-4926-9d80-dc6693183ec3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:24.197619 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-82cbfd68-4b0a-4926-9d80-dc6693183ec3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:24.198380 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-82cbfd68-4b0a-4926-9d80-dc6693183ec3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:24.198812 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-82cbfd68-4b0a-4926-9d80-dc6693183ec3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:24.340331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-82cbfd68-4b0a-4926-9d80-dc6693183ec3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:24.352081 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-82cbfd68-4b0a-4926-9d80-dc6693183ec3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1569 microversion: 2.1 time: 0.172943 Jun 28 03:23:24.352750 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 334/668] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:24 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:24.368725 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-878ca146-e216-4f19-b129-ebedd0506740 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:23:24.369280 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-878ca146-e216-4f19-b129-ebedd0506740 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:24.375690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-878ca146-e216-4f19-b129-ebedd0506740 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:24.376132 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-878ca146-e216-4f19-b129-ebedd0506740 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:24.376917 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-878ca146-e216-4f19-b129-ebedd0506740 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:24.377351 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-878ca146-e216-4f19-b129-ebedd0506740 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:24.456651 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-878ca146-e216-4f19-b129-ebedd0506740 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "POST /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62/action" status: 202 len: 0 microversion: 2.1 time: 0.091601 Jun 28 03:23:24.457327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 335/669] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:23:24 2022] POST /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:23:24.465279 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-bf033356-3c79-4625-9564-5289257ec27d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:24.465870 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-bf033356-3c79-4625-9564-5289257ec27d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:24.471923 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bf033356-3c79-4625-9564-5289257ec27d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:24.472392 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bf033356-3c79-4625-9564-5289257ec27d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:24.473148 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bf033356-3c79-4625-9564-5289257ec27d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:24.473572 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bf033356-3c79-4625-9564-5289257ec27d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:24.620103 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-bf033356-3c79-4625-9564-5289257ec27d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:24.626977 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ade7c2d8-53c9-466b-880c-d703c4a8b406 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:24.627855 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ade7c2d8-53c9-466b-880c-d703c4a8b406 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:24.629094 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:24.634325 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-bf033356-3c79-4625-9564-5289257ec27d tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1577 microversion: 2.1 time: 0.172838 Jun 28 03:23:24.634772 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ade7c2d8-53c9-466b-880c-d703c4a8b406 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:24.635222 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ade7c2d8-53c9-466b-880c-d703c4a8b406 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:24.635990 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ade7c2d8-53c9-466b-880c-d703c4a8b406 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:24.636348 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 335/670] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:24 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:24.637136 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ade7c2d8-53c9-466b-880c-d703c4a8b406 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:24.772727 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ade7c2d8-53c9-466b-880c-d703c4a8b406 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:24.774967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:24.781870 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ade7c2d8-53c9-466b-880c-d703c4a8b406 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:24.783242 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ade7c2d8-53c9-466b-880c-d703c4a8b406 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:24.784418 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ade7c2d8-53c9-466b-880c-d703c4a8b406 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.161402 Jun 28 03:23:24.784978 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 336/671] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:24 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:25.655980 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-aaa3867e-6050-4fa4-ab64-067752ce4dfd tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:25.657033 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-aaa3867e-6050-4fa4-ab64-067752ce4dfd tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:25.666566 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aaa3867e-6050-4fa4-ab64-067752ce4dfd tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:25.667069 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aaa3867e-6050-4fa4-ab64-067752ce4dfd tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:25.667821 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aaa3867e-6050-4fa4-ab64-067752ce4dfd tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:25.668227 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aaa3867e-6050-4fa4-ab64-067752ce4dfd tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:25.804347 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-832e4506-bfb5-400f-9bb6-75911636c227 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:25.804934 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-832e4506-bfb5-400f-9bb6-75911636c227 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:25.812047 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-aaa3867e-6050-4fa4-ab64-067752ce4dfd tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:25.812820 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-832e4506-bfb5-400f-9bb6-75911636c227 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:25.813402 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-832e4506-bfb5-400f-9bb6-75911636c227 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:25.814144 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-832e4506-bfb5-400f-9bb6-75911636c227 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:25.814537 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-832e4506-bfb5-400f-9bb6-75911636c227 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:25.821557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-aaa3867e-6050-4fa4-ab64-067752ce4dfd tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1519 microversion: 2.1 time: 0.172091 Jun 28 03:23:25.831310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 336/672] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:25 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:25.957702 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-832e4506-bfb5-400f-9bb6-75911636c227 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:25.966922 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-832e4506-bfb5-400f-9bb6-75911636c227 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:25.968668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-832e4506-bfb5-400f-9bb6-75911636c227 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:25.969873 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-832e4506-bfb5-400f-9bb6-75911636c227 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.170812 Jun 28 03:23:25.970662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 337/673] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:25 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:26.839235 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e7516cb2-780a-4a7e-b579-180a8b8b04c3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:26.839836 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e7516cb2-780a-4a7e-b579-180a8b8b04c3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:26.847161 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e7516cb2-780a-4a7e-b579-180a8b8b04c3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:26.847597 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e7516cb2-780a-4a7e-b579-180a8b8b04c3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:26.848404 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e7516cb2-780a-4a7e-b579-180a8b8b04c3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:26.848833 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e7516cb2-780a-4a7e-b579-180a8b8b04c3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:26.988610 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ef338620-b9c7-4e33-b8b4-70f31f3016bc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:26.989194 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ef338620-b9c7-4e33-b8b4-70f31f3016bc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:26.996352 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ef338620-b9c7-4e33-b8b4-70f31f3016bc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:26.996773 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ef338620-b9c7-4e33-b8b4-70f31f3016bc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:26.997564 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ef338620-b9c7-4e33-b8b4-70f31f3016bc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:26.997993 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ef338620-b9c7-4e33-b8b4-70f31f3016bc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:27.098923 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e7516cb2-780a-4a7e-b579-180a8b8b04c3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:27.108515 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e7516cb2-780a-4a7e-b579-180a8b8b04c3 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1575 microversion: 2.1 time: 0.273153 Jun 28 03:23:27.109080 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 337/674] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:26 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1575 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:27.162211 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ef338620-b9c7-4e33-b8b4-70f31f3016bc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:27.171472 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ef338620-b9c7-4e33-b8b4-70f31f3016bc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:27.172997 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ef338620-b9c7-4e33-b8b4-70f31f3016bc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:27.174153 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ef338620-b9c7-4e33-b8b4-70f31f3016bc tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.189491 Jun 28 03:23:27.174713 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 338/675] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:26 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:28.018445 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-ca225634-a672-4ceb-bb36-eee67d6d1915 req-c0deaa21-4d17-4b5a-8f0b-9d276ba303aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e97b7a4-a1fb-4757-8d7f-d16a84c5561c", "name": "network-vif-plugged", "status": "completed", "tag": "02235355-6547-49bd-a247-cc3176e99f9e"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:23:28.027296 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-ca225634-a672-4ceb-bb36-eee67d6d1915 req-c0deaa21-4d17-4b5a-8f0b-9d276ba303aa service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:28.027802 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-ca225634-a672-4ceb-bb36-eee67d6d1915 req-c0deaa21-4d17-4b5a-8f0b-9d276ba303aa service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:28.040291 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-ca225634-a672-4ceb-bb36-eee67d6d1915 req-c0deaa21-4d17-4b5a-8f0b-9d276ba303aa service nova] Creating event network-vif-plugged:02235355-6547-49bd-a247-cc3176e99f9e for instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c on hv-cinder-84684 Jun 28 03:23:28.045481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-ca225634-a672-4ceb-bb36-eee67d6d1915 req-c0deaa21-4d17-4b5a-8f0b-9d276ba303aa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030817 Jun 28 03:23:28.046119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 338/676] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:23:28.126129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ea174bc1-a85a-41a9-9683-6e7606c11b85 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:28.126732 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ea174bc1-a85a-41a9-9683-6e7606c11b85 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:28.133413 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea174bc1-a85a-41a9-9683-6e7606c11b85 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:28.133859 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea174bc1-a85a-41a9-9683-6e7606c11b85 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:28.134611 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea174bc1-a85a-41a9-9683-6e7606c11b85 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:28.135043 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea174bc1-a85a-41a9-9683-6e7606c11b85 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:28.199604 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-524fd054-a906-4cb3-be5c-8cc200502aa8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:28.200440 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-524fd054-a906-4cb3-be5c-8cc200502aa8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:28.206847 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-524fd054-a906-4cb3-be5c-8cc200502aa8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:28.207348 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-524fd054-a906-4cb3-be5c-8cc200502aa8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:28.208219 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-524fd054-a906-4cb3-be5c-8cc200502aa8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:28.208752 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-524fd054-a906-4cb3-be5c-8cc200502aa8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:28.304387 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ea174bc1-a85a-41a9-9683-6e7606c11b85 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:28.314917 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ea174bc1-a85a-41a9-9683-6e7606c11b85 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1575 microversion: 2.1 time: 0.192695 Jun 28 03:23:28.315474 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 339/677] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:28 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:28.422749 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-524fd054-a906-4cb3-be5c-8cc200502aa8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:28.432519 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-524fd054-a906-4cb3-be5c-8cc200502aa8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:28.433987 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-524fd054-a906-4cb3-be5c-8cc200502aa8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:28.435177 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-524fd054-a906-4cb3-be5c-8cc200502aa8 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.240859 Jun 28 03:23:28.435763 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 339/678] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:28 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:23:29.336435 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f0ca8f0b-4a5e-46a3-9bd4-51e1c21d5555 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:29.337737 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f0ca8f0b-4a5e-46a3-9bd4-51e1c21d5555 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:29.349023 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f0ca8f0b-4a5e-46a3-9bd4-51e1c21d5555 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:29.349792 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f0ca8f0b-4a5e-46a3-9bd4-51e1c21d5555 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:29.351046 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f0ca8f0b-4a5e-46a3-9bd4-51e1c21d5555 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:29.352124 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f0ca8f0b-4a5e-46a3-9bd4-51e1c21d5555 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:29.453364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2ecf426a-db3f-4ad1-89c0-dd40f7ec0b1f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:29.453951 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2ecf426a-db3f-4ad1-89c0-dd40f7ec0b1f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:29.461158 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2ecf426a-db3f-4ad1-89c0-dd40f7ec0b1f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:29.462163 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2ecf426a-db3f-4ad1-89c0-dd40f7ec0b1f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:29.462922 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2ecf426a-db3f-4ad1-89c0-dd40f7ec0b1f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:29.463359 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2ecf426a-db3f-4ad1-89c0-dd40f7ec0b1f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:29.490802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f0ca8f0b-4a5e-46a3-9bd4-51e1c21d5555 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:29.498521 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f0ca8f0b-4a5e-46a3-9bd4-51e1c21d5555 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1575 microversion: 2.1 time: 0.168534 Jun 28 03:23:29.499060 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 340/679] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:29 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:29.592773 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2ecf426a-db3f-4ad1-89c0-dd40f7ec0b1f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:29.601294 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2ecf426a-db3f-4ad1-89c0-dd40f7ec0b1f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:29.603210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2ecf426a-db3f-4ad1-89c0-dd40f7ec0b1f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:29.604766 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2ecf426a-db3f-4ad1-89c0-dd40f7ec0b1f tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.155379 Jun 28 03:23:29.605298 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 340/680] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:29 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:30.515010 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a31d2acf-02c6-4d95-8ecd-582016806adb tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:30.515622 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a31d2acf-02c6-4d95-8ecd-582016806adb tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:30.522265 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a31d2acf-02c6-4d95-8ecd-582016806adb tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:30.522699 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a31d2acf-02c6-4d95-8ecd-582016806adb tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:30.523443 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a31d2acf-02c6-4d95-8ecd-582016806adb tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:30.524017 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a31d2acf-02c6-4d95-8ecd-582016806adb tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:30.623111 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ac2b8233-fb6b-4afe-9e13-f491d450f97c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:30.624020 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ac2b8233-fb6b-4afe-9e13-f491d450f97c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:30.630713 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ac2b8233-fb6b-4afe-9e13-f491d450f97c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:30.631253 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ac2b8233-fb6b-4afe-9e13-f491d450f97c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:30.632131 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ac2b8233-fb6b-4afe-9e13-f491d450f97c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:30.632675 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ac2b8233-fb6b-4afe-9e13-f491d450f97c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:30.680691 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a31d2acf-02c6-4d95-8ecd-582016806adb tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:30.688916 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a31d2acf-02c6-4d95-8ecd-582016806adb tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1575 microversion: 2.1 time: 0.177771 Jun 28 03:23:30.689413 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 341/681] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:30 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:30.800357 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ac2b8233-fb6b-4afe-9e13-f491d450f97c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:30.810417 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ac2b8233-fb6b-4afe-9e13-f491d450f97c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:30.812272 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ac2b8233-fb6b-4afe-9e13-f491d450f97c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:30.813739 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ac2b8233-fb6b-4afe-9e13-f491d450f97c tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1730 microversion: 2.20 time: 0.194504 Jun 28 03:23:30.814478 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 341/682] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:30 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 28 03:23:31.709876 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e123dd46-780a-4a3e-b7ef-6e0a9bb4bb3b tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:31.710785 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e123dd46-780a-4a3e-b7ef-6e0a9bb4bb3b tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:31.721198 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e123dd46-780a-4a3e-b7ef-6e0a9bb4bb3b tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:31.721757 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e123dd46-780a-4a3e-b7ef-6e0a9bb4bb3b tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:31.722810 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e123dd46-780a-4a3e-b7ef-6e0a9bb4bb3b tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:31.723232 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e123dd46-780a-4a3e-b7ef-6e0a9bb4bb3b tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:31.832462 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7dda6d29-164f-401b-9629-e1c999a92e12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:31.833049 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7dda6d29-164f-401b-9629-e1c999a92e12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:31.840187 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7dda6d29-164f-401b-9629-e1c999a92e12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:31.840650 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7dda6d29-164f-401b-9629-e1c999a92e12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:31.841415 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7dda6d29-164f-401b-9629-e1c999a92e12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:31.841844 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7dda6d29-164f-401b-9629-e1c999a92e12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:31.868685 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e123dd46-780a-4a3e-b7ef-6e0a9bb4bb3b tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:31.876412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e123dd46-780a-4a3e-b7ef-6e0a9bb4bb3b tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1575 microversion: 2.1 time: 0.172809 Jun 28 03:23:31.877235 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 342/683] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:31 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:31.977605 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7dda6d29-164f-401b-9629-e1c999a92e12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:31.989085 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7dda6d29-164f-401b-9629-e1c999a92e12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:31.990593 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7dda6d29-164f-401b-9629-e1c999a92e12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:31.991756 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7dda6d29-164f-401b-9629-e1c999a92e12 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1717 microversion: 2.20 time: 0.163412 Jun 28 03:23:31.992348 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 342/684] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:23:31 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:23:32.470945 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-51b57a6a-695e-4d2d-a833-e211bfe96705 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:32.471429 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-51b57a6a-695e-4d2d-a833-e211bfe96705 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:32.477744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51b57a6a-695e-4d2d-a833-e211bfe96705 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:32.478188 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51b57a6a-695e-4d2d-a833-e211bfe96705 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:32.479379 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51b57a6a-695e-4d2d-a833-e211bfe96705 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:32.479807 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51b57a6a-695e-4d2d-a833-e211bfe96705 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:32.570966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-51b57a6a-695e-4d2d-a833-e211bfe96705 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lazy-loading 'services' on Instance uuid 88c49a8f-7779-4a9b-90dd-de3f851c517b {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:23:32.651493 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-51b57a6a-695e-4d2d-a833-e211bfe96705 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "DELETE /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-volume_attachments/cebc6dd4-8e1b-44f5-b9ae-2a3705a0874a" status: 202 len: 0 microversion: 2.1 time: 0.184271 Jun 28 03:23:32.652096 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 343/685] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 28 03:23:32 2022] DELETE /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-volume_attachments/cebc6dd4-8e1b-44f5-b9ae-2a3705a0874a => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:23:32.660544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c28b43ad-fdbe-4d54-8078-ea828b79626d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:32.661471 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c28b43ad-fdbe-4d54-8078-ea828b79626d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:32.667732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c28b43ad-fdbe-4d54-8078-ea828b79626d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:32.668107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c28b43ad-fdbe-4d54-8078-ea828b79626d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:32.668881 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c28b43ad-fdbe-4d54-8078-ea828b79626d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:32.669300 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c28b43ad-fdbe-4d54-8078-ea828b79626d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:32.697395 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c28b43ad-fdbe-4d54-8078-ea828b79626d tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040761 Jun 28 03:23:32.697909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 343/686] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:23:32 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:23:32.898845 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-55ad6726-3c07-426f-9144-6327086f1a1e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:32.900000 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-55ad6726-3c07-426f-9144-6327086f1a1e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:32.907149 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-55ad6726-3c07-426f-9144-6327086f1a1e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:32.907590 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-55ad6726-3c07-426f-9144-6327086f1a1e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:32.908374 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-55ad6726-3c07-426f-9144-6327086f1a1e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:32.908803 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-55ad6726-3c07-426f-9144-6327086f1a1e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:33.054842 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-55ad6726-3c07-426f-9144-6327086f1a1e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:33.063028 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-55ad6726-3c07-426f-9144-6327086f1a1e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1575 microversion: 2.1 time: 0.171994 Jun 28 03:23:33.063608 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 344/687] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:32 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:33.713493 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a8e714b6-b058-49e1-9f0b-d6ba21d37de1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:33.714400 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a8e714b6-b058-49e1-9f0b-d6ba21d37de1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:33.721762 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a8e714b6-b058-49e1-9f0b-d6ba21d37de1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:33.722224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a8e714b6-b058-49e1-9f0b-d6ba21d37de1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:33.723008 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a8e714b6-b058-49e1-9f0b-d6ba21d37de1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:33.723453 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a8e714b6-b058-49e1-9f0b-d6ba21d37de1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:33.755136 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a8e714b6-b058-49e1-9f0b-d6ba21d37de1 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048437 Jun 28 03:23:33.755685 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 344/688] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:23:33 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:23:34.080598 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6725803d-85f5-4e10-90c5-a3c2dd368c2e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:34.081306 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6725803d-85f5-4e10-90c5-a3c2dd368c2e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:34.088229 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6725803d-85f5-4e10-90c5-a3c2dd368c2e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:34.088713 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6725803d-85f5-4e10-90c5-a3c2dd368c2e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:34.089478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6725803d-85f5-4e10-90c5-a3c2dd368c2e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:34.089886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6725803d-85f5-4e10-90c5-a3c2dd368c2e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:34.226439 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6725803d-85f5-4e10-90c5-a3c2dd368c2e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:34.234371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6725803d-85f5-4e10-90c5-a3c2dd368c2e tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1575 microversion: 2.1 time: 0.157667 Jun 28 03:23:34.234939 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 345/689] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:34 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:34.767972 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d969eb7a-ec19-4ad2-be07-bae5711bcc15 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:34.768903 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d969eb7a-ec19-4ad2-be07-bae5711bcc15 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:34.776067 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d969eb7a-ec19-4ad2-be07-bae5711bcc15 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:34.776535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d969eb7a-ec19-4ad2-be07-bae5711bcc15 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:34.777281 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d969eb7a-ec19-4ad2-be07-bae5711bcc15 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:34.777704 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d969eb7a-ec19-4ad2-be07-bae5711bcc15 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:34.811060 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d969eb7a-ec19-4ad2-be07-bae5711bcc15 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047033 Jun 28 03:23:34.811649 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 345/690] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:23:34 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 03:23:34.877398 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b680845c-9588-4cf4-bfba-5bcb7d1465dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:34.878095 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b680845c-9588-4cf4-bfba-5bcb7d1465dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:34.886566 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b680845c-9588-4cf4-bfba-5bcb7d1465dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:34.887011 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b680845c-9588-4cf4-bfba-5bcb7d1465dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:34.887766 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b680845c-9588-4cf4-bfba-5bcb7d1465dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:34.888226 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b680845c-9588-4cf4-bfba-5bcb7d1465dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:34.916832 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b680845c-9588-4cf4-bfba-5bcb7d1465dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:23:35.003058 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b680845c-9588-4cf4-bfba-5bcb7d1465dc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "DELETE /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 204 len: 0 microversion: 2.1 time: 0.129932 Jun 28 03:23:35.003939 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 346/691] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:23:34 2022] DELETE /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:23:35.012556 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-914320aa-7685-4df4-a5c5-6960ce91add3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:35.013213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-914320aa-7685-4df4-a5c5-6960ce91add3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:35.019835 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-914320aa-7685-4df4-a5c5-6960ce91add3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:35.020321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-914320aa-7685-4df4-a5c5-6960ce91add3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:35.021117 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-914320aa-7685-4df4-a5c5-6960ce91add3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:35.021545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-914320aa-7685-4df4-a5c5-6960ce91add3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:35.164696 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-914320aa-7685-4df4-a5c5-6960ce91add3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:35.172324 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-914320aa-7685-4df4-a5c5-6960ce91add3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1689 microversion: 2.1 time: 0.164229 Jun 28 03:23:35.172881 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 346/692] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:35 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:23:35.256905 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a38f6fcd-7529-4999-a12a-e3e92297af36 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:35.257495 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a38f6fcd-7529-4999-a12a-e3e92297af36 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:35.264964 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a38f6fcd-7529-4999-a12a-e3e92297af36 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:35.265407 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a38f6fcd-7529-4999-a12a-e3e92297af36 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:35.266167 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a38f6fcd-7529-4999-a12a-e3e92297af36 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:35.266638 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a38f6fcd-7529-4999-a12a-e3e92297af36 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:35.411833 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a38f6fcd-7529-4999-a12a-e3e92297af36 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:35.420090 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a38f6fcd-7529-4999-a12a-e3e92297af36 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1575 microversion: 2.1 time: 0.170212 Jun 28 03:23:35.420685 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 347/693] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:35 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:36.192255 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2eda72ad-c3e3-42de-bdbf-6ecac633b451 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:36.192889 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2eda72ad-c3e3-42de-bdbf-6ecac633b451 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:36.200007 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2eda72ad-c3e3-42de-bdbf-6ecac633b451 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:36.200483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2eda72ad-c3e3-42de-bdbf-6ecac633b451 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:36.201256 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2eda72ad-c3e3-42de-bdbf-6ecac633b451 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:36.201686 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2eda72ad-c3e3-42de-bdbf-6ecac633b451 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:36.341198 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2eda72ad-c3e3-42de-bdbf-6ecac633b451 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:36.349303 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2eda72ad-c3e3-42de-bdbf-6ecac633b451 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1689 microversion: 2.1 time: 0.163346 Jun 28 03:23:36.349874 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 347/694] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:36 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:36.438326 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-65d6e9b5-6f57-402a-a0c0-718312b589d6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:36.438951 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-65d6e9b5-6f57-402a-a0c0-718312b589d6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:36.446649 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65d6e9b5-6f57-402a-a0c0-718312b589d6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:36.447128 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65d6e9b5-6f57-402a-a0c0-718312b589d6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:36.447999 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65d6e9b5-6f57-402a-a0c0-718312b589d6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:36.448501 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65d6e9b5-6f57-402a-a0c0-718312b589d6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:36.584385 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-65d6e9b5-6f57-402a-a0c0-718312b589d6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:36.597438 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-65d6e9b5-6f57-402a-a0c0-718312b589d6 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1575 microversion: 2.1 time: 0.163544 Jun 28 03:23:36.598356 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 348/695] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:36 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:37.370917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-03deb7a8-e0e4-43eb-b48f-4450f92cb8fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:37.371931 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-03deb7a8-e0e4-43eb-b48f-4450f92cb8fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:37.382952 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-03deb7a8-e0e4-43eb-b48f-4450f92cb8fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:37.383690 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-03deb7a8-e0e4-43eb-b48f-4450f92cb8fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:37.384964 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-03deb7a8-e0e4-43eb-b48f-4450f92cb8fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:37.385666 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-03deb7a8-e0e4-43eb-b48f-4450f92cb8fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:37.527495 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-03deb7a8-e0e4-43eb-b48f-4450f92cb8fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:37.535549 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-03deb7a8-e0e4-43eb-b48f-4450f92cb8fc tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1689 microversion: 2.1 time: 0.171185 Jun 28 03:23:37.536111 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 348/696] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:37 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:37.617553 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-09365616-6edb-4b80-91b9-2d128a143e38 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:37.618370 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-09365616-6edb-4b80-91b9-2d128a143e38 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:37.626650 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-09365616-6edb-4b80-91b9-2d128a143e38 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:37.627026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-09365616-6edb-4b80-91b9-2d128a143e38 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:37.627785 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-09365616-6edb-4b80-91b9-2d128a143e38 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:37.628240 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-09365616-6edb-4b80-91b9-2d128a143e38 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:37.766667 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-09365616-6edb-4b80-91b9-2d128a143e38 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:37.774675 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-09365616-6edb-4b80-91b9-2d128a143e38 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1575 microversion: 2.1 time: 0.162714 Jun 28 03:23:37.775237 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 349/697] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:37 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:38.114676 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-f3c41a8a-8626-4677-b599-4733a033c078 req-54b3bf0a-0a02-49f3-a6ef-2a4cedf304da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d20165-bd26-4933-9494-f57e12a4af62", "name": "network-vif-plugged", "status": "completed", "tag": "5ef0c0c3-3a01-4e07-9e58-af12fe750d01"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:23:38.122986 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-f3c41a8a-8626-4677-b599-4733a033c078 req-54b3bf0a-0a02-49f3-a6ef-2a4cedf304da service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:38.123634 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-f3c41a8a-8626-4677-b599-4733a033c078 req-54b3bf0a-0a02-49f3-a6ef-2a4cedf304da service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:38.134355 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-f3c41a8a-8626-4677-b599-4733a033c078 req-54b3bf0a-0a02-49f3-a6ef-2a4cedf304da service nova] Creating event network-vif-plugged:5ef0c0c3-3a01-4e07-9e58-af12fe750d01 for instance 18d20165-bd26-4933-9494-f57e12a4af62 on hv-cinder-84684 Jun 28 03:23:38.139641 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-f3c41a8a-8626-4677-b599-4733a033c078 req-54b3bf0a-0a02-49f3-a6ef-2a4cedf304da service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091656 Jun 28 03:23:38.140142 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 349/698] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:23:38.468326 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-10141aed-58fa-4db3-ade3-2412e1aaf17e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:38.469106 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-10141aed-58fa-4db3-ade3-2412e1aaf17e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:38.475254 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-10141aed-58fa-4db3-ade3-2412e1aaf17e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:38.475693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-10141aed-58fa-4db3-ade3-2412e1aaf17e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:38.476469 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-10141aed-58fa-4db3-ade3-2412e1aaf17e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:38.476892 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-10141aed-58fa-4db3-ade3-2412e1aaf17e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:38.499554 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-10141aed-58fa-4db3-ade3-2412e1aaf17e tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/ips" status: 200 len: 149 microversion: 2.1 time: 0.096947 Jun 28 03:23:38.500140 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 350/699] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 28 03:23:38 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/ips => generated 149 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:23:38.553796 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-19b307eb-da6e-43f3-b49a-4a456475d7ae tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:38.554471 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-19b307eb-da6e-43f3-b49a-4a456475d7ae tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:38.560848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-19b307eb-da6e-43f3-b49a-4a456475d7ae tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:38.561293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-19b307eb-da6e-43f3-b49a-4a456475d7ae tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:38.562040 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-19b307eb-da6e-43f3-b49a-4a456475d7ae tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:38.562482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-19b307eb-da6e-43f3-b49a-4a456475d7ae tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:38.700542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-19b307eb-da6e-43f3-b49a-4a456475d7ae tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:38.708762 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-19b307eb-da6e-43f3-b49a-4a456475d7ae tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1689 microversion: 2.1 time: 0.159646 Jun 28 03:23:38.709608 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 350/700] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:38 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:38.791583 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6ba83306-7086-4000-a846-699d613adf39 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:38.792540 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6ba83306-7086-4000-a846-699d613adf39 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:38.799399 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6ba83306-7086-4000-a846-699d613adf39 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:38.799941 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6ba83306-7086-4000-a846-699d613adf39 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:38.800823 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6ba83306-7086-4000-a846-699d613adf39 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:38.801318 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6ba83306-7086-4000-a846-699d613adf39 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:38.816414 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:38.975690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6ba83306-7086-4000-a846-699d613adf39 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:38.988676 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6ba83306-7086-4000-a846-699d613adf39 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1575 microversion: 2.1 time: 0.201437 Jun 28 03:23:38.989628 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 351/701] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:38 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:39.726812 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ea82e0e7-ce4e-4e8a-841f-646acd67f1d3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:39.727210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ea82e0e7-ce4e-4e8a-841f-646acd67f1d3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:39.734445 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea82e0e7-ce4e-4e8a-841f-646acd67f1d3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:39.735110 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea82e0e7-ce4e-4e8a-841f-646acd67f1d3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:39.738421 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea82e0e7-ce4e-4e8a-841f-646acd67f1d3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:39.741589 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea82e0e7-ce4e-4e8a-841f-646acd67f1d3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:39.819639 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ea82e0e7-ce4e-4e8a-841f-646acd67f1d3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:39.827349 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ea82e0e7-ce4e-4e8a-841f-646acd67f1d3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1621 microversion: 2.1 time: 0.104743 Jun 28 03:23:39.828089 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 351/702] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:39 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1621 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:39.846747 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-42303c09-2b85-414d-8523-c93b8af21762 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "958c51e0-d80f-4205-a937-3774e4277e3c"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:23:39.847887 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-42303c09-2b85-414d-8523-c93b8af21762 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:39.854841 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-42303c09-2b85-414d-8523-c93b8af21762 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:39.855249 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-42303c09-2b85-414d-8523-c93b8af21762 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:39.856027 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-42303c09-2b85-414d-8523-c93b8af21762 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:39.856478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-42303c09-2b85-414d-8523-c93b8af21762 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:40.010644 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-257cb846-a7bd-41f8-9e75-e7418f5e5951 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:40.011249 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-257cb846-a7bd-41f8-9e75-e7418f5e5951 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:40.018133 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-257cb846-a7bd-41f8-9e75-e7418f5e5951 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:40.018552 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-257cb846-a7bd-41f8-9e75-e7418f5e5951 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:40.019539 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-257cb846-a7bd-41f8-9e75-e7418f5e5951 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:40.020006 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-257cb846-a7bd-41f8-9e75-e7418f5e5951 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:40.164297 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-257cb846-a7bd-41f8-9e75-e7418f5e5951 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:40.172543 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-257cb846-a7bd-41f8-9e75-e7418f5e5951 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1575 microversion: 2.1 time: 0.166174 Jun 28 03:23:40.173123 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 352/703] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:40 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:23:40.247957 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-763fc7cd-4a41-48c5-b310-2479c7adb937 req-8dfc2402-d639-4e1b-8e6d-9b6e6b06bfec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c49a8f-7779-4a9b-90dd-de3f851c517b", "name": "network-vif-deleted", "tag": "fdbb463e-d574-49cc-aabd-b6a74106c928"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:23:40.256179 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-763fc7cd-4a41-48c5-b310-2479c7adb937 req-8dfc2402-d639-4e1b-8e6d-9b6e6b06bfec service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:40.256621 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-763fc7cd-4a41-48c5-b310-2479c7adb937 req-8dfc2402-d639-4e1b-8e6d-9b6e6b06bfec service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:40.267507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-763fc7cd-4a41-48c5-b310-2479c7adb937 req-8dfc2402-d639-4e1b-8e6d-9b6e6b06bfec service nova] Creating event network-vif-deleted:fdbb463e-d574-49cc-aabd-b6a74106c928 for instance 88c49a8f-7779-4a9b-90dd-de3f851c517b on hv-cinder-84684 Jun 28 03:23:40.272608 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-763fc7cd-4a41-48c5-b310-2479c7adb937 req-8dfc2402-d639-4e1b-8e6d-9b6e6b06bfec service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098082 Jun 28 03:23:40.273196 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 353/704] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:23:40.758579 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-42303c09-2b85-414d-8523-c93b8af21762 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "POST /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.915779 Jun 28 03:23:40.759525 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 352/705] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:23:39 2022] POST /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments => generated 194 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:23:40.846612 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-aad99c50-1326-4018-85c1-11f8e8777f43 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:40.847312 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-aad99c50-1326-4018-85c1-11f8e8777f43 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:40.854194 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aad99c50-1326-4018-85c1-11f8e8777f43 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:40.854678 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aad99c50-1326-4018-85c1-11f8e8777f43 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:40.855447 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aad99c50-1326-4018-85c1-11f8e8777f43 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:40.855939 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aad99c50-1326-4018-85c1-11f8e8777f43 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:40.876558 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=100 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:40.892139 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aad99c50-1326-4018-85c1-11f8e8777f43 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:40.892551 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aad99c50-1326-4018-85c1-11f8e8777f43 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:40.893008 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.objects.instance [None req-aad99c50-1326-4018-85c1-11f8e8777f43 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lazy-loading 'fault' on Instance uuid 88c49a8f-7779-4a9b-90dd-de3f851c517b {{(pid=117681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:23:40.939156 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-aad99c50-1326-4018-85c1-11f8e8777f43 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:40.947053 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-aad99c50-1326-4018-85c1-11f8e8777f43 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 200 len: 1334 microversion: 2.1 time: 0.105795 Jun 28 03:23:40.947628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 354/706] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:40 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 1334 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:41.190622 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d494147f-37e7-4e89-9c57-38af0d2657ae tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:41.191505 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d494147f-37e7-4e89-9c57-38af0d2657ae tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:41.198799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d494147f-37e7-4e89-9c57-38af0d2657ae tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:41.199284 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d494147f-37e7-4e89-9c57-38af0d2657ae tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:41.200048 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d494147f-37e7-4e89-9c57-38af0d2657ae tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:41.200518 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d494147f-37e7-4e89-9c57-38af0d2657ae tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:41.336636 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d494147f-37e7-4e89-9c57-38af0d2657ae tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:41.347314 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d494147f-37e7-4e89-9c57-38af0d2657ae tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1562 microversion: 2.1 time: 0.161685 Jun 28 03:23:41.347959 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 353/707] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:41 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:23:41.966605 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8e0b4e2e-71e1-422c-871b-609c2758a3f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:41.967237 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-8e0b4e2e-71e1-422c-871b-609c2758a3f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 88c49a8f-7779-4a9b-90dd-de3f851c517b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:41.974095 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8e0b4e2e-71e1-422c-871b-609c2758a3f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:41.974565 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8e0b4e2e-71e1-422c-871b-609c2758a3f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:41.975303 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8e0b4e2e-71e1-422c-871b-609c2758a3f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:41.975730 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8e0b4e2e-71e1-422c-871b-609c2758a3f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:41.990418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-8e0b4e2e-71e1-422c-871b-609c2758a3f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] HTTP exception thrown: Instance 88c49a8f-7779-4a9b-90dd-de3f851c517b could not be found. Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8e0b4e2e-71e1-422c-871b-609c2758a3f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Request method failure captured: Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b HTTP/1.1 Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunM9Dd2r6ks5CIlIc9oHLOKluAAH5hNuDeG-EEwuyeKomrNFLTxgh-zrC0miKybndMxw9Cdi-BV0GgnKfutXJVMSeZgCSN-M0pbBhLprVRMibFfdu2RtmOFIDlDK49KX0XgdbKcGw2_LDDpApk_-py0nMs4uP1Q9olzEBrp7uDcYaAI Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: c1e596746cc64a1981804d95f1906bb3 Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:23:41.992030 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:23:41.993528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c1e596746cc64a1981804d95f1906bb3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:23:41.993528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:23:41.993528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: c1e596746cc64a1981804d95f1906bb3 Jun 28 03:23:41.993528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:23:41.993528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-ServerRescueNegativeTestJSON-1266345582-project Jun 28 03:23:41.993528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:23:41.993528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:23:41.993528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: facb00bcd5644550a93901791f77b89c Jun 28 03:23:41.993528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1266345582-project Jun 28 03:23:41.993528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:23:41.993528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 88c49a8f-7779-4a9b-90dd-de3f851c517b could not be found. Jun 28 03:23:41.993528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '88c49a8f-7779-4a9b-90dd-de3f851c517b'} Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c49a8f-7779-4a9b-90dd-de3f851c517b could not be found. Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:23:41.994362 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c49a8f-7779-4a9b-90dd-de3f851c517b could not be found. Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c49a8f-7779-4a9b-90dd-de3f851c517b could not be found. Jun 28 03:23:41.995824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:23:41.997380 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8e0b4e2e-71e1-422c-871b-609c2758a3f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Returning 404 to user: Instance 88c49a8f-7779-4a9b-90dd-de3f851c517b could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:23:41.997380 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-8e0b4e2e-71e1-422c-871b-609c2758a3f8 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b" status: 404 len: 111 microversion: 2.1 time: 0.030792 Jun 28 03:23:41.997380 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 355/708] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:41 2022] GET /compute/v2.1/servers/88c49a8f-7779-4a9b-90dd-de3f851c517b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:23:42.002210 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a5d38261-3b0a-4147-8126-26aad0e42df6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '.version_select at 0x7f53f1aae310>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:42.022879 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a5d38261-3b0a-4147-8126-26aad0e42df6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-856977450" status: 202 len: 0 microversion: 2.1 time: 0.024405 Jun 28 03:23:42.023416 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 354/709] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jun 28 03:23:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-856977450 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:23:44.937900 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e7c1fe5c-c326-4f06-be6d-dba89f6e82b9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:44.938422 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e7c1fe5c-c326-4f06-be6d-dba89f6e82b9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:44.945514 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e7c1fe5c-c326-4f06-be6d-dba89f6e82b9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:44.945961 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e7c1fe5c-c326-4f06-be6d-dba89f6e82b9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:44.946713 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e7c1fe5c-c326-4f06-be6d-dba89f6e82b9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:44.947146 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e7c1fe5c-c326-4f06-be6d-dba89f6e82b9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:44.972799 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e7c1fe5c-c326-4f06-be6d-dba89f6e82b9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Going to try to terminate instance {{(pid=117681) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:23:45.057553 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e7c1fe5c-c326-4f06-be6d-dba89f6e82b9 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 204 len: 0 microversion: 2.1 time: 0.123136 Jun 28 03:23:45.058134 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 356/710] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:23:44 2022] DELETE /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:23:45.067423 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-16d8e510-0cf1-4e6d-b66c-67586cd370b6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:45.068027 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-16d8e510-0cf1-4e6d-b66c-67586cd370b6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:45.074489 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-16d8e510-0cf1-4e6d-b66c-67586cd370b6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:45.074933 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-16d8e510-0cf1-4e6d-b66c-67586cd370b6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:45.075768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-16d8e510-0cf1-4e6d-b66c-67586cd370b6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:45.076262 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-16d8e510-0cf1-4e6d-b66c-67586cd370b6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:45.226882 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-16d8e510-0cf1-4e6d-b66c-67586cd370b6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:45.234976 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-16d8e510-0cf1-4e6d-b66c-67586cd370b6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1508 microversion: 2.1 time: 0.172355 Jun 28 03:23:45.235638 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 355/711] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:45 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:46.257929 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4d3468d6-97e1-4015-9b50-37df27516da3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:46.258621 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4d3468d6-97e1-4015-9b50-37df27516da3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:46.265924 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4d3468d6-97e1-4015-9b50-37df27516da3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:46.266366 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4d3468d6-97e1-4015-9b50-37df27516da3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:46.267133 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4d3468d6-97e1-4015-9b50-37df27516da3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:46.267566 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4d3468d6-97e1-4015-9b50-37df27516da3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:46.413654 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4d3468d6-97e1-4015-9b50-37df27516da3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:46.421543 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4d3468d6-97e1-4015-9b50-37df27516da3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1508 microversion: 2.1 time: 0.167811 Jun 28 03:23:46.422067 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 357/712] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:46 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:47.442414 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d9bf966d-7cc0-4ca5-a699-3291db10ba3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:47.443453 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d9bf966d-7cc0-4ca5-a699-3291db10ba3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:47.454706 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d9bf966d-7cc0-4ca5-a699-3291db10ba3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:47.455127 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d9bf966d-7cc0-4ca5-a699-3291db10ba3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:47.455909 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d9bf966d-7cc0-4ca5-a699-3291db10ba3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:47.456380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d9bf966d-7cc0-4ca5-a699-3291db10ba3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:47.591443 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d9bf966d-7cc0-4ca5-a699-3291db10ba3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:47.600546 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d9bf966d-7cc0-4ca5-a699-3291db10ba3a tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1508 microversion: 2.1 time: 0.165104 Jun 28 03:23:47.601114 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 356/713] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:47 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:48.623660 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-14b1c27c-bdeb-424a-b1e3-c52311aa19b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:48.624976 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-14b1c27c-bdeb-424a-b1e3-c52311aa19b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:48.632189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-14b1c27c-bdeb-424a-b1e3-c52311aa19b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:48.632900 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-14b1c27c-bdeb-424a-b1e3-c52311aa19b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:48.633833 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-14b1c27c-bdeb-424a-b1e3-c52311aa19b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:48.634413 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-14b1c27c-bdeb-424a-b1e3-c52311aa19b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:48.674202 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-2c475375-069b-4083-9bdf-e0e003f8fac9 req-aaea77f7-b11f-4975-890a-6bc6404c0288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e", "name": "network-vif-deleted", "tag": "4889afde-ba46-4d85-9672-9444704f0439"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:23:48.683745 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-2c475375-069b-4083-9bdf-e0e003f8fac9 req-aaea77f7-b11f-4975-890a-6bc6404c0288 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:48.684192 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-2c475375-069b-4083-9bdf-e0e003f8fac9 req-aaea77f7-b11f-4975-890a-6bc6404c0288 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:48.709211 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-2c475375-069b-4083-9bdf-e0e003f8fac9 req-aaea77f7-b11f-4975-890a-6bc6404c0288 service nova] Creating event network-vif-deleted:4889afde-ba46-4d85-9672-9444704f0439 for instance 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e on hv-cinder-84684 Jun 28 03:23:48.714668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-2c475375-069b-4083-9bdf-e0e003f8fac9 req-aaea77f7-b11f-4975-890a-6bc6404c0288 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044239 Jun 28 03:23:48.715500 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 357/714] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:23:48.718514 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-14b1c27c-bdeb-424a-b1e3-c52311aa19b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:48.727502 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-14b1c27c-bdeb-424a-b1e3-c52311aa19b3 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 200 len: 1466 microversion: 2.1 time: 0.111893 Jun 28 03:23:48.737603 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 358/715] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:48 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 1466 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:49.478111 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2a521d2f-44b8-4dbe-92f8-857ba8cc810d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:49.479035 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2a521d2f-44b8-4dbe-92f8-857ba8cc810d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:49.485642 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2a521d2f-44b8-4dbe-92f8-857ba8cc810d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:49.486056 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2a521d2f-44b8-4dbe-92f8-857ba8cc810d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:49.486809 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2a521d2f-44b8-4dbe-92f8-857ba8cc810d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:49.487289 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2a521d2f-44b8-4dbe-92f8-857ba8cc810d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:49.571550 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-2a521d2f-44b8-4dbe-92f8-857ba8cc810d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lazy-loading 'services' on Instance uuid 0eb95203-3c4a-4225-9282-bd035696ef59 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:23:49.647455 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2a521d2f-44b8-4dbe-92f8-857ba8cc810d tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments/958c51e0-d80f-4205-a937-3774e4277e3c" status: 202 len: 0 microversion: 2.1 time: 0.173470 Jun 28 03:23:49.648074 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 358/716] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 28 03:23:49 2022] DELETE /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments/958c51e0-d80f-4205-a937-3774e4277e3c => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:23:49.656553 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-32fb6d65-ade5-47dd-bddc-ee71b53d729b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:49.657545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-32fb6d65-ade5-47dd-bddc-ee71b53d729b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:49.664985 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-32fb6d65-ade5-47dd-bddc-ee71b53d729b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:49.665466 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-32fb6d65-ade5-47dd-bddc-ee71b53d729b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:49.666436 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-32fb6d65-ade5-47dd-bddc-ee71b53d729b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:49.666843 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-32fb6d65-ade5-47dd-bddc-ee71b53d729b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:49.699706 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-32fb6d65-ade5-47dd-bddc-ee71b53d729b tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047182 Jun 28 03:23:49.700282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 359/717] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:23:49 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:23:49.745738 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-45b4ce26-894c-467e-8b1f-5e763ec392dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:49.746451 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-45b4ce26-894c-467e-8b1f-5e763ec392dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:49.752788 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45b4ce26-894c-467e-8b1f-5e763ec392dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:49.753228 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45b4ce26-894c-467e-8b1f-5e763ec392dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:49.754080 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45b4ce26-894c-467e-8b1f-5e763ec392dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:49.754483 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45b4ce26-894c-467e-8b1f-5e763ec392dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:49.768692 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-45b4ce26-894c-467e-8b1f-5e763ec392dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] HTTP exception thrown: Instance 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e could not be found. Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-45b4ce26-894c-467e-8b1f-5e763ec392dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Request method failure captured: Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e HTTP/1.1 Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunM9Dd2r6ks5CIlIc9oHLOKluAAH5hNuDeG-EEwuyeKomrNFLTxgh-zrC0miKybndMxw9Cdi-BV0GgnKfutXJVMSeZgCSN-M0pbBhLprVRMibFfdu2RtmOFIDlDK49KX0XgdbKcGw2_LDDpApk_-py0nMs4uP1Q9olzEBrp7uDcYaAI Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: c1e596746cc64a1981804d95f1906bb3 Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:23:49.770393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:23:49.771800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c1e596746cc64a1981804d95f1906bb3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:23:49.771800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:23:49.771800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: c1e596746cc64a1981804d95f1906bb3 Jun 28 03:23:49.771800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:23:49.771800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-ServerRescueNegativeTestJSON-1266345582-project Jun 28 03:23:49.771800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:23:49.771800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:23:49.771800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: facb00bcd5644550a93901791f77b89c Jun 28 03:23:49.771800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1266345582-project Jun 28 03:23:49.771800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:23:49.771800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e could not be found. Jun 28 03:23:49.771800 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e'} Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e could not be found. Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:23:49.775548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e could not be found. Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e could not be found. Jun 28 03:23:49.776966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:23:49.778185 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-45b4ce26-894c-467e-8b1f-5e763ec392dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Returning 404 to user: Instance 3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:23:49.778185 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-45b4ce26-894c-467e-8b1f-5e763ec392dd tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e" status: 404 len: 111 microversion: 2.1 time: 0.030650 Jun 28 03:23:49.778185 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 359/718] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:49 2022] GET /compute/v2.1/servers/3bcb7ec7-0224-47ee-9a52-ace78fc4fb2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:23:49.780314 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4a331b39-981a-43f7-98dd-194541226191 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:49.780946 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4a331b39-981a-43f7-98dd-194541226191 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:49.787083 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4a331b39-981a-43f7-98dd-194541226191 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:49.787520 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4a331b39-981a-43f7-98dd-194541226191 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:49.788291 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4a331b39-981a-43f7-98dd-194541226191 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:49.788718 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4a331b39-981a-43f7-98dd-194541226191 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:49.813897 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4a331b39-981a-43f7-98dd-194541226191 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Going to try to terminate instance {{(pid=117681) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:23:49.895578 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4a331b39-981a-43f7-98dd-194541226191 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 204 len: 0 microversion: 2.1 time: 0.118893 Jun 28 03:23:49.896217 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 360/719] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:23:49 2022] DELETE /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 28 03:23:49.904438 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3954f576-27c2-435c-a161-bbf874d02e65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:49.905046 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3954f576-27c2-435c-a161-bbf874d02e65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:49.911485 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3954f576-27c2-435c-a161-bbf874d02e65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:49.911930 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3954f576-27c2-435c-a161-bbf874d02e65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:49.912734 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3954f576-27c2-435c-a161-bbf874d02e65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:49.913162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3954f576-27c2-435c-a161-bbf874d02e65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:50.053304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3954f576-27c2-435c-a161-bbf874d02e65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:50.061266 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3954f576-27c2-435c-a161-bbf874d02e65 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.160809 Jun 28 03:23:50.061871 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 360/720] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:49 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:23:50.718116 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-73836d81-4d9b-4950-89fe-ce1553d3e238 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:50.719556 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-73836d81-4d9b-4950-89fe-ce1553d3e238 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:50.727589 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-73836d81-4d9b-4950-89fe-ce1553d3e238 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:50.728036 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-73836d81-4d9b-4950-89fe-ce1553d3e238 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:50.729187 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-73836d81-4d9b-4950-89fe-ce1553d3e238 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:50.729614 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-73836d81-4d9b-4950-89fe-ce1553d3e238 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:50.760293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-73836d81-4d9b-4950-89fe-ce1553d3e238 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049861 Jun 28 03:23:50.760871 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 361/721] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:23:50 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:23:51.079257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-754b0bf1-0f45-4d14-bed6-f76a5d7a4978 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:51.079817 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-754b0bf1-0f45-4d14-bed6-f76a5d7a4978 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:51.082738 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:51.088749 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-754b0bf1-0f45-4d14-bed6-f76a5d7a4978 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:51.089187 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-754b0bf1-0f45-4d14-bed6-f76a5d7a4978 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:51.089934 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-754b0bf1-0f45-4d14-bed6-f76a5d7a4978 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:51.090362 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-754b0bf1-0f45-4d14-bed6-f76a5d7a4978 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:51.235480 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-754b0bf1-0f45-4d14-bed6-f76a5d7a4978 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:51.248566 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-754b0bf1-0f45-4d14-bed6-f76a5d7a4978 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.172860 Jun 28 03:23:51.249218 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 361/722] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:51 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:51.774390 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d3e5acc7-95b5-49f5-903a-ae2b2a975662 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:51.775310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d3e5acc7-95b5-49f5-903a-ae2b2a975662 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:51.782427 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d3e5acc7-95b5-49f5-903a-ae2b2a975662 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:51.782861 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d3e5acc7-95b5-49f5-903a-ae2b2a975662 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:51.783612 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d3e5acc7-95b5-49f5-903a-ae2b2a975662 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:51.784058 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d3e5acc7-95b5-49f5-903a-ae2b2a975662 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:51.813939 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d3e5acc7-95b5-49f5-903a-ae2b2a975662 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 Jun 28 03:23:51.814484 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 362/723] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:23:51 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:23:52.271339 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ab2527b5-dc93-41c5-9e6e-2420c718860e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:52.272363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ab2527b5-dc93-41c5-9e6e-2420c718860e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:52.283561 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab2527b5-dc93-41c5-9e6e-2420c718860e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:52.284363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab2527b5-dc93-41c5-9e6e-2420c718860e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:52.285442 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab2527b5-dc93-41c5-9e6e-2420c718860e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:52.285868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab2527b5-dc93-41c5-9e6e-2420c718860e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:52.693677 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ab2527b5-dc93-41c5-9e6e-2420c718860e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:52.701450 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ab2527b5-dc93-41c5-9e6e-2420c718860e tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.436741 Jun 28 03:23:52.702056 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 362/724] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:52 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:52.831296 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f41c3b1b-5177-474b-a71e-a1c2d463a4c8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:52.832905 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f41c3b1b-5177-474b-a71e-a1c2d463a4c8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:52.844029 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f41c3b1b-5177-474b-a71e-a1c2d463a4c8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:52.844809 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f41c3b1b-5177-474b-a71e-a1c2d463a4c8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:52.846053 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f41c3b1b-5177-474b-a71e-a1c2d463a4c8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:52.846757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f41c3b1b-5177-474b-a71e-a1c2d463a4c8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:52.877185 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f41c3b1b-5177-474b-a71e-a1c2d463a4c8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052478 Jun 28 03:23:52.877657 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 363/725] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:23:52 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:23:53.718614 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cb566e54-4baa-404c-809d-08bdd4504031 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:53.719283 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cb566e54-4baa-404c-809d-08bdd4504031 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:53.726454 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cb566e54-4baa-404c-809d-08bdd4504031 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:53.727125 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cb566e54-4baa-404c-809d-08bdd4504031 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:53.728082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cb566e54-4baa-404c-809d-08bdd4504031 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:53.728908 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cb566e54-4baa-404c-809d-08bdd4504031 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:53.887924 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ef9db3d5-82b7-49ee-bc49-b5f0ca4f6c1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:53.889468 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ef9db3d5-82b7-49ee-bc49-b5f0ca4f6c1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:53.913314 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:53.914634 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ef9db3d5-82b7-49ee-bc49-b5f0ca4f6c1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:53.915208 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ef9db3d5-82b7-49ee-bc49-b5f0ca4f6c1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:53.917326 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ef9db3d5-82b7-49ee-bc49-b5f0ca4f6c1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:53.918055 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ef9db3d5-82b7-49ee-bc49-b5f0ca4f6c1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:53.953360 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ef9db3d5-82b7-49ee-bc49-b5f0ca4f6c1a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069232 Jun 28 03:23:53.953828 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cb566e54-4baa-404c-809d-08bdd4504031 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:53.955063 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 364/726] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:23:53 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 28 03:23:53.964016 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cb566e54-4baa-404c-809d-08bdd4504031 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1522 microversion: 2.1 time: 0.249177 Jun 28 03:23:53.964920 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 363/727] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:53 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:54.028647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-88a30ae5-deb3-412b-824e-6ba26fc21481 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:54.029160 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-88a30ae5-deb3-412b-824e-6ba26fc21481 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:54.036635 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-88a30ae5-deb3-412b-824e-6ba26fc21481 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:54.037234 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-88a30ae5-deb3-412b-824e-6ba26fc21481 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:54.038013 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-88a30ae5-deb3-412b-824e-6ba26fc21481 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:54.038629 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-88a30ae5-deb3-412b-824e-6ba26fc21481 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:54.065120 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-88a30ae5-deb3-412b-824e-6ba26fc21481 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Going to try to terminate instance {{(pid=117681) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:23:54.171609 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-88a30ae5-deb3-412b-824e-6ba26fc21481 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 204 len: 0 microversion: 2.1 time: 0.147238 Jun 28 03:23:54.172683 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 365/728] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:23:54 2022] DELETE /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:23:54.184860 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d6bf5632-a2ca-4e7b-8222-9e78d24203dd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:54.186405 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d6bf5632-a2ca-4e7b-8222-9e78d24203dd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:54.188908 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-635065fa-2f33-4eda-bacb-0ff2307c159a req-acf3842d-f10e-4ea3-b6f3-cdcd440939cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fbc89ef-8230-45d5-b3ee-efb863e5340e", "name": "network-vif-deleted", "tag": "f19332ea-cc5d-476d-b4fd-c455a47a5f3f"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:23:54.194619 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d6bf5632-a2ca-4e7b-8222-9e78d24203dd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:54.195171 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d6bf5632-a2ca-4e7b-8222-9e78d24203dd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:54.196103 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d6bf5632-a2ca-4e7b-8222-9e78d24203dd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:54.196677 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d6bf5632-a2ca-4e7b-8222-9e78d24203dd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:54.199135 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-635065fa-2f33-4eda-bacb-0ff2307c159a req-acf3842d-f10e-4ea3-b6f3-cdcd440939cd service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:54.199789 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-635065fa-2f33-4eda-bacb-0ff2307c159a req-acf3842d-f10e-4ea3-b6f3-cdcd440939cd service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:54.211877 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-635065fa-2f33-4eda-bacb-0ff2307c159a req-acf3842d-f10e-4ea3-b6f3-cdcd440939cd service nova] Creating event network-vif-deleted:f19332ea-cc5d-476d-b4fd-c455a47a5f3f for instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e on hv-cinder-84684 Jun 28 03:23:54.216739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-635065fa-2f33-4eda-bacb-0ff2307c159a req-acf3842d-f10e-4ea3-b6f3-cdcd440939cd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094023 Jun 28 03:23:54.217945 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 364/729] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:23:54.227211 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:54.361242 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d6bf5632-a2ca-4e7b-8222-9e78d24203dd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:54.373037 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d6bf5632-a2ca-4e7b-8222-9e78d24203dd tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1681 microversion: 2.1 time: 0.193785 Jun 28 03:23:54.373827 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 366/730] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:54 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:54.986570 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-65154831-3230-40df-a882-07cbb71b22e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:54.987701 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-65154831-3230-40df-a882-07cbb71b22e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:54.999267 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65154831-3230-40df-a882-07cbb71b22e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:54.999896 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65154831-3230-40df-a882-07cbb71b22e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:55.001562 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65154831-3230-40df-a882-07cbb71b22e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:55.002315 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65154831-3230-40df-a882-07cbb71b22e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:55.034758 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65154831-3230-40df-a882-07cbb71b22e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:55.035167 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-65154831-3230-40df-a882-07cbb71b22e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:55.035689 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-65154831-3230-40df-a882-07cbb71b22e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lazy-loading 'fault' on Instance uuid 9fbc89ef-8230-45d5-b3ee-efb863e5340e {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:23:55.077271 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-65154831-3230-40df-a882-07cbb71b22e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:55.085503 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-65154831-3230-40df-a882-07cbb71b22e6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1312 microversion: 2.1 time: 0.105929 Jun 28 03:23:55.086065 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 365/731] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:54 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:55.394927 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-bcdcae4d-ef72-412a-9afd-942b7b18bcdf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:55.395937 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-bcdcae4d-ef72-412a-9afd-942b7b18bcdf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:55.408095 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bcdcae4d-ef72-412a-9afd-942b7b18bcdf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:55.408887 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bcdcae4d-ef72-412a-9afd-942b7b18bcdf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:55.410138 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bcdcae4d-ef72-412a-9afd-942b7b18bcdf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:55.410856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bcdcae4d-ef72-412a-9afd-942b7b18bcdf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:55.555241 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-bcdcae4d-ef72-412a-9afd-942b7b18bcdf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:55.563124 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-bcdcae4d-ef72-412a-9afd-942b7b18bcdf tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1681 microversion: 2.1 time: 0.174735 Jun 28 03:23:55.563705 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 367/732] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:55 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:56.105497 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-492fbec2-93a0-47bd-b287-d4b7abd581f6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:56.106227 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-492fbec2-93a0-47bd-b287-d4b7abd581f6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:56.114650 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-492fbec2-93a0-47bd-b287-d4b7abd581f6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:56.115228 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-492fbec2-93a0-47bd-b287-d4b7abd581f6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:56.116205 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-492fbec2-93a0-47bd-b287-d4b7abd581f6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:56.116739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-492fbec2-93a0-47bd-b287-d4b7abd581f6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:56.151527 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-492fbec2-93a0-47bd-b287-d4b7abd581f6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:56.151972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-492fbec2-93a0-47bd-b287-d4b7abd581f6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:56.152417 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-492fbec2-93a0-47bd-b287-d4b7abd581f6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lazy-loading 'fault' on Instance uuid 9fbc89ef-8230-45d5-b3ee-efb863e5340e {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:23:56.193901 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-492fbec2-93a0-47bd-b287-d4b7abd581f6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'facb00bcd5644550a93901791f77b89c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1e596746cc64a1981804d95f1906bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:56.201901 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-492fbec2-93a0-47bd-b287-d4b7abd581f6 tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 200 len: 1312 microversion: 2.1 time: 0.102420 Jun 28 03:23:56.202471 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 366/733] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:56 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:56.587031 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-be47b5b0-cef9-4c4b-ac93-9c3d02f8aad8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:56.587628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-be47b5b0-cef9-4c4b-ac93-9c3d02f8aad8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:56.594387 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-be47b5b0-cef9-4c4b-ac93-9c3d02f8aad8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:56.594824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-be47b5b0-cef9-4c4b-ac93-9c3d02f8aad8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:56.595568 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-be47b5b0-cef9-4c4b-ac93-9c3d02f8aad8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:56.595991 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-be47b5b0-cef9-4c4b-ac93-9c3d02f8aad8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:56.827489 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-be47b5b0-cef9-4c4b-ac93-9c3d02f8aad8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:56.835246 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-be47b5b0-cef9-4c4b-ac93-9c3d02f8aad8 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1681 microversion: 2.1 time: 0.256088 Jun 28 03:23:56.835879 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 368/734] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:56 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1681 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:23:57.218701 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ec7d7efe-4136-48c4-a2b9-9d8e62e8ba7b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:57.219305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ec7d7efe-4136-48c4-a2b9-9d8e62e8ba7b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] [instance: 9fbc89ef-8230-45d5-b3ee-efb863e5340e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:57.227967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec7d7efe-4136-48c4-a2b9-9d8e62e8ba7b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:57.228965 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec7d7efe-4136-48c4-a2b9-9d8e62e8ba7b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:57.231389 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec7d7efe-4136-48c4-a2b9-9d8e62e8ba7b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:57.231389 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec7d7efe-4136-48c4-a2b9-9d8e62e8ba7b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:57.245881 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-ec7d7efe-4136-48c4-a2b9-9d8e62e8ba7b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] HTTP exception thrown: Instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e could not be found. Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ec7d7efe-4136-48c4-a2b9-9d8e62e8ba7b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Request method failure captured: Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e HTTP/1.1 Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunM9Dd2r6ks5CIlIc9oHLOKluAAH5hNuDeG-EEwuyeKomrNFLTxgh-zrC0miKybndMxw9Cdi-BV0GgnKfutXJVMSeZgCSN-M0pbBhLprVRMibFfdu2RtmOFIDlDK49KX0XgdbKcGw2_LDDpApk_-py0nMs4uP1Q9olzEBrp7uDcYaAI Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: c1e596746cc64a1981804d95f1906bb3 Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:23:57.247515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:23:57.248927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c1e596746cc64a1981804d95f1906bb3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1e596746cc64a1981804d95f1906bb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:23:57.248927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:23:57.248927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: c1e596746cc64a1981804d95f1906bb3 Jun 28 03:23:57.248927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1266345582 Jun 28 03:23:57.248927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-ServerRescueNegativeTestJSON-1266345582-project Jun 28 03:23:57.248927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:23:57.248927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:23:57.248927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: facb00bcd5644550a93901791f77b89c Jun 28 03:23:57.248927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1266345582-project Jun 28 03:23:57.248927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:23:57.248927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e could not be found. Jun 28 03:23:57.248927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '9fbc89ef-8230-45d5-b3ee-efb863e5340e'} Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e could not be found. Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:23:57.249693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e could not be found. Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e could not be found. Jun 28 03:23:57.251018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:23:57.252488 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ec7d7efe-4136-48c4-a2b9-9d8e62e8ba7b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] Returning 404 to user: Instance 9fbc89ef-8230-45d5-b3ee-efb863e5340e could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:23:57.252488 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ec7d7efe-4136-48c4-a2b9-9d8e62e8ba7b tempest-ServerRescueNegativeTestJSON-1266345582 tempest-ServerRescueNegativeTestJSON-1266345582-project] 10.222.0.44 "GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e" status: 404 len: 111 microversion: 2.1 time: 0.034164 Jun 28 03:23:57.252488 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 367/735] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:57 2022] GET /compute/v2.1/servers/9fbc89ef-8230-45d5-b3ee-efb863e5340e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:23:57.535666 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-5fde244a-3ace-4e7d-96a7-3d1a9bf0c238 req-6871b766-0533-49c8-95b0-fe743846a48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb95203-3c4a-4225-9282-bd035696ef59", "name": "network-vif-deleted", "tag": "cfd747c8-04ee-403a-8dcd-75a533cbca9e"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:23:57.544691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-5fde244a-3ace-4e7d-96a7-3d1a9bf0c238 req-6871b766-0533-49c8-95b0-fe743846a48c service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:57.545079 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-5fde244a-3ace-4e7d-96a7-3d1a9bf0c238 req-6871b766-0533-49c8-95b0-fe743846a48c service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:57.557643 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-5fde244a-3ace-4e7d-96a7-3d1a9bf0c238 req-6871b766-0533-49c8-95b0-fe743846a48c service nova] Creating event network-vif-deleted:cfd747c8-04ee-403a-8dcd-75a533cbca9e for instance 0eb95203-3c4a-4225-9282-bd035696ef59 on hv-cinder-84684 Jun 28 03:23:57.562881 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-5fde244a-3ace-4e7d-96a7-3d1a9bf0c238 req-6871b766-0533-49c8-95b0-fe743846a48c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031092 Jun 28 03:23:57.564003 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 369/736] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:23:57.853722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5db8a0d1-90fb-49e6-8bbb-7587faf2a8b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:57.855587 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5db8a0d1-90fb-49e6-8bbb-7587faf2a8b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:57.862224 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5db8a0d1-90fb-49e6-8bbb-7587faf2a8b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:57.862754 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5db8a0d1-90fb-49e6-8bbb-7587faf2a8b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:57.863588 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5db8a0d1-90fb-49e6-8bbb-7587faf2a8b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:57.864119 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5db8a0d1-90fb-49e6-8bbb-7587faf2a8b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:57.901130 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5db8a0d1-90fb-49e6-8bbb-7587faf2a8b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:57.901695 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5db8a0d1-90fb-49e6-8bbb-7587faf2a8b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:57.902211 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-5db8a0d1-90fb-49e6-8bbb-7587faf2a8b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lazy-loading 'fault' on Instance uuid 0eb95203-3c4a-4225-9282-bd035696ef59 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:23:57.944362 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5db8a0d1-90fb-49e6-8bbb-7587faf2a8b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4181737f6f2348d2906aea642b8598f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f6b05085584fd5beecbe54c7251525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:23:57.947039 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:23:57.954146 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5db8a0d1-90fb-49e6-8bbb-7587faf2a8b4 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 200 len: 1331 microversion: 2.1 time: 0.104851 Jun 28 03:23:57.954790 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 368/737] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:57 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:23:58.972810 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6190d1f1-b952-43a0-9c7b-0115f76b48ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:58.974080 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6190d1f1-b952-43a0-9c7b-0115f76b48ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:23:58.981190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6190d1f1-b952-43a0-9c7b-0115f76b48ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:58.981651 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6190d1f1-b952-43a0-9c7b-0115f76b48ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:58.982395 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6190d1f1-b952-43a0-9c7b-0115f76b48ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:23:58.982818 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6190d1f1-b952-43a0-9c7b-0115f76b48ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:23:58.996311 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-6190d1f1-b952-43a0-9c7b-0115f76b48ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6190d1f1-b952-43a0-9c7b-0115f76b48ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 HTTP/1.1 Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:23:58.997909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:23:58.999438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:23:58.999438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:23:58.999438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:23:58.999438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:23:58.999438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:23:58.999438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:23:58.999438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:23:58.999438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:23:58.999438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:23:58.999438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:23:58.999438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:23:58.999438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '0eb95203-3c4a-4225-9282-bd035696ef59'} Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:23:59.000602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:23:59.001997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:23:59.004525 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6190d1f1-b952-43a0-9c7b-0115f76b48ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 404 to user: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:23:59.004525 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6190d1f1-b952-43a0-9c7b-0115f76b48ae tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 404 len: 111 microversion: 2.1 time: 0.031422 Jun 28 03:23:59.004525 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 370/738] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:23:58 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:23:59.008203 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4c144af6-1442-4496-9472-d408fe76b110 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '.version_select at 0x7f53f1adec10>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:23:59.034292 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4c144af6-1442-4496-9472-d408fe76b110 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-968240381" status: 202 len: 0 microversion: 2.1 time: 0.029222 Jun 28 03:23:59.035719 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 369/739] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jun 28 03:23:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-968240381 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:24:00.869026 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-78ac7b62-1984-491d-9e04-6a434b95ed91 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:00.869590 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-78ac7b62-1984-491d-9e04-6a434b95ed91 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:00.876029 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-78ac7b62-1984-491d-9e04-6a434b95ed91 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:00.876517 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-78ac7b62-1984-491d-9e04-6a434b95ed91 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:00.877267 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-78ac7b62-1984-491d-9e04-6a434b95ed91 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:00.877691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-78ac7b62-1984-491d-9e04-6a434b95ed91 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:00.891843 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-78ac7b62-1984-491d-9e04-6a434b95ed91 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-78ac7b62-1984-491d-9e04-6a434b95ed91 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: DELETE /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 HTTP/1.1 Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:24:00.893482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:24:00.894942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:00.894942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:00.894942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:00.894942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:00.894942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:00.894942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:24:00.894942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:24:00.894942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:24:00.894942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:00.894942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:24:00.894942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:24:00.894942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '0eb95203-3c4a-4225-9282-bd035696ef59'} Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:00.895814 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:24:00.897126 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:00.898429 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-78ac7b62-1984-491d-9e04-6a434b95ed91 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 404 to user: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:00.898429 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-78ac7b62-1984-491d-9e04-6a434b95ed91 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 404 len: 111 microversion: 2.1 time: 0.029825 Jun 28 03:24:00.898429 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 371/740] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:24:00 2022] DELETE /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:00.904664 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-df9bf310-b475-424b-96cb-60c5cee4e0e0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:00.905348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-df9bf310-b475-424b-96cb-60c5cee4e0e0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 0eb95203-3c4a-4225-9282-bd035696ef59] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:00.912336 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-df9bf310-b475-424b-96cb-60c5cee4e0e0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:00.912860 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-df9bf310-b475-424b-96cb-60c5cee4e0e0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:00.913686 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-df9bf310-b475-424b-96cb-60c5cee4e0e0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:00.914401 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-df9bf310-b475-424b-96cb-60c5cee4e0e0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:00.927859 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-df9bf310-b475-424b-96cb-60c5cee4e0e0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-df9bf310-b475-424b-96cb-60c5cee4e0e0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 HTTP/1.1 Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:24:00.929543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:24:00.931220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:00.931220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:00.931220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:00.931220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:00.931220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:00.931220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:24:00.931220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:24:00.931220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:24:00.931220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:00.931220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:24:00.931220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:24:00.931220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '0eb95203-3c4a-4225-9282-bd035696ef59'} Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:00.932036 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. Jun 28 03:24:00.933412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:00.937710 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-df9bf310-b475-424b-96cb-60c5cee4e0e0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 404 to user: Instance 0eb95203-3c4a-4225-9282-bd035696ef59 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:00.937710 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-df9bf310-b475-424b-96cb-60c5cee4e0e0 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59" status: 404 len: 111 microversion: 2.1 time: 0.032195 Jun 28 03:24:00.937710 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 370/741] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:00 2022] GET /compute/v2.1/servers/0eb95203-3c4a-4225-9282-bd035696ef59 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:01.893962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-58dd2823-d0fc-4d87-9668-fceaece2bd41 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Action: 'create', calling method: .version_select at 0x7f53f1a321f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1261355571", "metadata": {"Type": "work"}}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-58dd2823-d0fc-4d87-9668-fceaece2bd41 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Request method failure captured: Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 122 Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunRRCjgS8XP60ykCgM1mmLXioh7WMM3imQpsoyk8TbbvMBT4UIfEYQui1zctkLNaxEabfERgyJbnsA52RsYvNywAva64vZ7-QA283DOwthuUwPZ6RqeHUDZME-lHjvSQdTqI6LQBszFi0MIo82KaIhGL_Qk4M6UOG-bN81awV1j79oE Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: b198b0cef14c4ee8b36b2a741d414019 Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:24:01.949767 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:24:01.951401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b198b0cef14c4ee8b36b2a741d414019", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:01.951401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:01.951401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: b198b0cef14c4ee8b36b2a741d414019 Jun 28 03:24:01.951401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:01.951401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-VolumesNegativeTest-1584831503-project Jun 28 03:24:01.951401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:24:01.951401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:24:01.951401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 6fc9dbfe16a04a69bc9c41a9362e7165 Jun 28 03:24:01.951401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-VolumesNegativeTest-1584831503-project Jun 28 03:24:01.951401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Jun 28 03:24:01.951401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1261355571", "metadata": {"Type": "work"}}} Jun 28 03:24:01.951401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: Jun 28 03:24:01.951401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1261355571', 'metadata': {'Type': 'work'}}}} Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise error Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi '#$%' Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:01.952507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 28 03:24:01.954162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 28 03:24:01.955352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 28 03:24:01.955352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.955352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-58dd2823-d0fc-4d87-9668-fceaece2bd41 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:01.955352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-58dd2823-d0fc-4d87-9668-fceaece2bd41 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.182400 Jun 28 03:24:01.955352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 372/742] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Jun 28 03:24:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 28 03:24:01.963198 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c43ef909-4e5a-4137-86df-10d8b8d1b757 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Action: 'create', calling method: .version_select at 0x7f53f1b20040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-235150595", "metadata": {"Type": "work"}}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c43ef909-4e5a-4137-86df-10d8b8d1b757 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Request method failure captured: Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 119 Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunRRCjgS8XP60ykCgM1mmLXioh7WMM3imQpsoyk8TbbvMBT4UIfEYQui1zctkLNaxEabfERgyJbnsA52RsYvNywAva64vZ7-QA283DOwthuUwPZ6RqeHUDZME-lHjvSQdTqI6LQBszFi0MIo82KaIhGL_Qk4M6UOG-bN81awV1j79oE Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: b198b0cef14c4ee8b36b2a741d414019 Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:24:01.966393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:24:01.967793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b198b0cef14c4ee8b36b2a741d414019", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:01.967793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:01.967793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: b198b0cef14c4ee8b36b2a741d414019 Jun 28 03:24:01.967793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:01.967793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesNegativeTest-1584831503-project Jun 28 03:24:01.967793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:24:01.967793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:24:01.967793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 6fc9dbfe16a04a69bc9c41a9362e7165 Jun 28 03:24:01.967793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesNegativeTest-1584831503-project Jun 28 03:24:01.967793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Jun 28 03:24:01.967793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-235150595", "metadata": {"Type": "work"}}} Jun 28 03:24:01.967793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: Jun 28 03:24:01.967793 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-235150595', 'metadata': {'Type': 'work'}}}} Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise error Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi '0' Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:01.968884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 28 03:24:01.970492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 28 03:24:01.971802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 28 03:24:01.971802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.971802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c43ef909-4e5a-4137-86df-10d8b8d1b757 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:01.971802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c43ef909-4e5a-4137-86df-10d8b8d1b757 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010034 Jun 28 03:24:01.971802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 371/743] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Jun 28 03:24:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 28 03:24:01.977276 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-5f73b49b-b41c-4fa4-a3fa-82a43cf8dd51 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Action: 'create', calling method: .version_select at 0x7f53f1e7f820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1971320422", "metadata": {"Type": "work"}}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-5f73b49b-b41c-4fa4-a3fa-82a43cf8dd51 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Request method failure captured: Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 119 Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunRRCjgS8XP60ykCgM1mmLXioh7WMM3imQpsoyk8TbbvMBT4UIfEYQui1zctkLNaxEabfERgyJbnsA52RsYvNywAva64vZ7-QA283DOwthuUwPZ6RqeHUDZME-lHjvSQdTqI6LQBszFi0MIo82KaIhGL_Qk4M6UOG-bN81awV1j79oE Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: b198b0cef14c4ee8b36b2a741d414019 Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:24:01.980803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:24:01.982342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b198b0cef14c4ee8b36b2a741d414019", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:01.982342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:01.982342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: b198b0cef14c4ee8b36b2a741d414019 Jun 28 03:24:01.982342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:01.982342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-VolumesNegativeTest-1584831503-project Jun 28 03:24:01.982342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:24:01.982342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:24:01.982342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 6fc9dbfe16a04a69bc9c41a9362e7165 Jun 28 03:24:01.982342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-VolumesNegativeTest-1584831503-project Jun 28 03:24:01.982342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Jun 28 03:24:01.982342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1971320422", "metadata": {"Type": "work"}}} Jun 28 03:24:01.982342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: Jun 28 03:24:01.982342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1971320422', 'metadata': {'Type': 'work'}}}} Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise error Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi '' Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:01.983364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 28 03:24:01.984901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 28 03:24:01.988545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 28 03:24:01.988545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:01.988545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-5f73b49b-b41c-4fa4-a3fa-82a43cf8dd51 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:01.988545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-5f73b49b-b41c-4fa4-a3fa-82a43cf8dd51 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008746 Jun 28 03:24:01.988545 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 373/744] 10.222.0.44 () {60 vars in 1155 bytes} [Tue Jun 28 03:24:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 28 03:24:01.991867 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-be12fd6d-710d-42de-9cca-97e45e4f8a25 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Calling method '.version_select at 0x7f53f1aecaf0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:02.020593 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-be12fd6d-710d-42de-9cca-97e45e4f8a25 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] HTTP exception thrown: Volume tempest-invalid-1021686569 could not be found. Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-be12fd6d-710d-42de-9cca-97e45e4f8a25 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Request method failure captured: Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1021686569 HTTP/1.1 Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunRRCjgS8XP60ykCgM1mmLXioh7WMM3imQpsoyk8TbbvMBT4UIfEYQui1zctkLNaxEabfERgyJbnsA52RsYvNywAva64vZ7-QA283DOwthuUwPZ6RqeHUDZME-lHjvSQdTqI6LQBszFi0MIo82KaIhGL_Qk4M6UOG-bN81awV1j79oE Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: b198b0cef14c4ee8b36b2a741d414019 Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:24:02.022557 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:24:02.024118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b198b0cef14c4ee8b36b2a741d414019", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:02.024118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:02.024118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: b198b0cef14c4ee8b36b2a741d414019 Jun 28 03:24:02.024118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:02.024118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesNegativeTest-1584831503-project Jun 28 03:24:02.024118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:24:02.024118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:24:02.024118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 6fc9dbfe16a04a69bc9c41a9362e7165 Jun 28 03:24:02.024118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesNegativeTest-1584831503-project Jun 28 03:24:02.024118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: Jun 28 03:24:02.024118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Volume tempest-invalid-1021686569 could not be found. Jun 28 03:24:02.024118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': 'tempest-invalid-1021686569'} Jun 28 03:24:02.024118 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1021686569 could not be found. (HTTP 404) (Request-ID: req-0ecce04c-e6ca-4bcb-b9e1-951f51d8386b) Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.025053 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 03:24:02.026164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1021686569 could not be found. Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:02.027972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1021686569 could not be found. Jun 28 03:24:02.029346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.029346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.029346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.029346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.029346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.029346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.029346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:02.029346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:02.029346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1021686569 could not be found. Jun 28 03:24:02.029346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.029346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-be12fd6d-710d-42de-9cca-97e45e4f8a25 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Returning 404 to user: Volume tempest-invalid-1021686569 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:02.029346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-be12fd6d-710d-42de-9cca-97e45e4f8a25 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1021686569" status: 404 len: 99 microversion: 2.1 time: 0.036851 Jun 28 03:24:02.029346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 372/745] 10.222.0.44 () {58 vars in 1217 bytes} [Tue Jun 28 03:24:01 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1021686569 => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 28 03:24:02.033700 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d7c79d36-a788-4baf-9f36-5e500fb2e8c9 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003783 Jun 28 03:24:02.034186 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 374/746] 10.222.0.44 () {58 vars in 1139 bytes} [Tue Jun 28 03:24:02 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 28 03:24:02.042348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d5536468-76da-4a90-816b-5d4ef3184866 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003836 Jun 28 03:24:02.042799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 373/747] 10.222.0.44 () {58 vars in 1136 bytes} [Tue Jun 28 03:24:02 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 28 03:24:02.050886 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b9a973c5-1ff7-417d-b731-3810d2d30776 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Calling method '.version_select at 0x7f53f1b11dc0>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:02.080109 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-b9a973c5-1ff7-417d-b731-3810d2d30776 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] HTTP exception thrown: Volume d3342754-2243-45c7-bf23-850df4a9c899 could not be found. Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b9a973c5-1ff7-417d-b731-3810d2d30776 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Request method failure captured: Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: DELETE /compute/v2.1/os-volumes/d3342754-2243-45c7-bf23-850df4a9c899 HTTP/1.1 Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunRRCjgS8XP60ykCgM1mmLXioh7WMM3imQpsoyk8TbbvMBT4UIfEYQui1zctkLNaxEabfERgyJbnsA52RsYvNywAva64vZ7-QA283DOwthuUwPZ6RqeHUDZME-lHjvSQdTqI6LQBszFi0MIo82KaIhGL_Qk4M6UOG-bN81awV1j79oE Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: b198b0cef14c4ee8b36b2a741d414019 Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:24:02.082091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:24:02.083628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b198b0cef14c4ee8b36b2a741d414019", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:02.083628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:02.083628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: b198b0cef14c4ee8b36b2a741d414019 Jun 28 03:24:02.083628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:02.083628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-VolumesNegativeTest-1584831503-project Jun 28 03:24:02.083628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:24:02.083628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:24:02.083628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 6fc9dbfe16a04a69bc9c41a9362e7165 Jun 28 03:24:02.083628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-VolumesNegativeTest-1584831503-project Jun 28 03:24:02.083628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: Jun 28 03:24:02.083628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Volume d3342754-2243-45c7-bf23-850df4a9c899 could not be found. Jun 28 03:24:02.083628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': 'd3342754-2243-45c7-bf23-850df4a9c899'} Jun 28 03:24:02.083628 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d3342754-2243-45c7-bf23-850df4a9c899 could not be found. (HTTP 404) (Request-ID: req-7a9835c6-980d-4117-87ab-6e61bca4adb7) Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.084712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 28 03:24:02.085770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d3342754-2243-45c7-bf23-850df4a9c899 could not be found. Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 28 03:24:02.087523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d3342754-2243-45c7-bf23-850df4a9c899 could not be found. Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d3342754-2243-45c7-bf23-850df4a9c899 could not be found. Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b9a973c5-1ff7-417d-b731-3810d2d30776 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Returning 404 to user: Volume d3342754-2243-45c7-bf23-850df4a9c899 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b9a973c5-1ff7-417d-b731-3810d2d30776 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/d3342754-2243-45c7-bf23-850df4a9c899" status: 404 len: 109 microversion: 2.1 time: 0.035989 Jun 28 03:24:02.089301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 375/748] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 28 03:24:02 2022] DELETE /compute/v2.1/os-volumes/d3342754-2243-45c7-bf23-850df4a9c899 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:02.090304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-77e2b4c5-8c5b-4cc8-be85-74ed3db966a3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:02.090304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-77e2b4c5-8c5b-4cc8-be85-74ed3db966a3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:02.092645 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77e2b4c5-8c5b-4cc8-be85-74ed3db966a3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:02.093085 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77e2b4c5-8c5b-4cc8-be85-74ed3db966a3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:02.093842 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77e2b4c5-8c5b-4cc8-be85-74ed3db966a3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:02.094262 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77e2b4c5-8c5b-4cc8-be85-74ed3db966a3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:02.094979 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9debc9c8-4fbf-4af1-875f-a97a249709d3 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Calling method '.version_select at 0x7f53f1a32ca0>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:02.108808 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-77e2b4c5-8c5b-4cc8-be85-74ed3db966a3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-77e2b4c5-8c5b-4cc8-be85-74ed3db966a3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: DELETE /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da HTTP/1.1 Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:24:02.110166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:24:02.112008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:02.112008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:02.112008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:02.112008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:02.112008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:02.112008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:24:02.112008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:24:02.112008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:24:02.112008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:02.112008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:24:02.112008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:24:02.112008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da'} Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:02.113026 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:24:02.114169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.115693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-77e2b4c5-8c5b-4cc8-be85-74ed3db966a3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 404 to user: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:02.115693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-77e2b4c5-8c5b-4cc8-be85-74ed3db966a3 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 404 len: 111 microversion: 2.1 time: 0.030505 Jun 28 03:24:02.115693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 374/749] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:24:02 2022] DELETE /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 03:24:02.120569 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4f5dd8bf-966a-47c7-b2d0-af61b2535861 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:02.121110 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4f5dd8bf-966a-47c7-b2d0-af61b2535861 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:02.124774 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-9debc9c8-4fbf-4af1-875f-a97a249709d3 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] HTTP exception thrown: Volume 8d295fe3-3474-4601-9f4a-bdbc9ba3f428 could not be found. Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9debc9c8-4fbf-4af1-875f-a97a249709d3 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Request method failure captured: Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/os-volumes/8d295fe3-3474-4601-9f4a-bdbc9ba3f428 HTTP/1.1 Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunRRCjgS8XP60ykCgM1mmLXioh7WMM3imQpsoyk8TbbvMBT4UIfEYQui1zctkLNaxEabfERgyJbnsA52RsYvNywAva64vZ7-QA283DOwthuUwPZ6RqeHUDZME-lHjvSQdTqI6LQBszFi0MIo82KaIhGL_Qk4M6UOG-bN81awV1j79oE Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: b198b0cef14c4ee8b36b2a741d414019 Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:24:02.126693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:24:02.128247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b198b0cef14c4ee8b36b2a741d414019", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b198b0cef14c4ee8b36b2a741d414019"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:02.128247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:02.128247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: b198b0cef14c4ee8b36b2a741d414019 Jun 28 03:24:02.128247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-VolumesNegativeTest-1584831503 Jun 28 03:24:02.128247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-VolumesNegativeTest-1584831503-project Jun 28 03:24:02.128247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:24:02.128247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:24:02.128247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 6fc9dbfe16a04a69bc9c41a9362e7165 Jun 28 03:24:02.128247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-VolumesNegativeTest-1584831503-project Jun 28 03:24:02.128247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: Jun 28 03:24:02.128247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Volume 8d295fe3-3474-4601-9f4a-bdbc9ba3f428 could not be found. Jun 28 03:24:02.128247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '8d295fe3-3474-4601-9f4a-bdbc9ba3f428'} Jun 28 03:24:02.128247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d295fe3-3474-4601-9f4a-bdbc9ba3f428 could not be found. (HTTP 404) (Request-ID: req-1039fe39-bfe1-4e51-a3e0-686378719de4) Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.129172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 28 03:24:02.130337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d295fe3-3474-4601-9f4a-bdbc9ba3f428 could not be found. Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 28 03:24:02.131391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:02.132917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d295fe3-3474-4601-9f4a-bdbc9ba3f428 could not be found. Jun 28 03:24:02.132917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.132917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.132917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.132917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.132917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.132917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.132917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:02.132917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:02.132917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d295fe3-3474-4601-9f4a-bdbc9ba3f428 could not be found. Jun 28 03:24:02.132917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.132917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9debc9c8-4fbf-4af1-875f-a97a249709d3 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] Returning 404 to user: Volume 8d295fe3-3474-4601-9f4a-bdbc9ba3f428 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:02.133619 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f5dd8bf-966a-47c7-b2d0-af61b2535861 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:02.133705 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-9debc9c8-4fbf-4af1-875f-a97a249709d3 tempest-VolumesNegativeTest-1584831503 tempest-VolumesNegativeTest-1584831503-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/8d295fe3-3474-4601-9f4a-bdbc9ba3f428" status: 404 len: 109 microversion: 2.1 time: 0.037109 Jun 28 03:24:02.133811 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f5dd8bf-966a-47c7-b2d0-af61b2535861 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:02.133986 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 376/750] 10.222.0.44 () {58 vars in 1244 bytes} [Tue Jun 28 03:24:02 2022] GET /compute/v2.1/os-volumes/8d295fe3-3474-4601-9f4a-bdbc9ba3f428 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:02.135254 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f5dd8bf-966a-47c7-b2d0-af61b2535861 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:02.135254 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f5dd8bf-966a-47c7-b2d0-af61b2535861 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:02.144134 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-4f5dd8bf-966a-47c7-b2d0-af61b2535861 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4f5dd8bf-966a-47c7-b2d0-af61b2535861 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da HTTP/1.1 Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:24:02.145668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:24:02.147147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:02.147147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:02.147147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:02.147147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:02.147147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:02.147147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:24:02.147147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:24:02.147147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:24:02.147147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:02.147147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:24:02.147147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:24:02.147147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da'} Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:02.148718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. Jun 28 03:24:02.150129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.151522 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4f5dd8bf-966a-47c7-b2d0-af61b2535861 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 404 to user: Instance 87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:02.151522 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4f5dd8bf-966a-47c7-b2d0-af61b2535861 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da" status: 404 len: 111 microversion: 2.1 time: 0.030342 Jun 28 03:24:02.151522 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 375/751] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:02 2022] GET /compute/v2.1/servers/87f9f1f8-7a5b-4a3e-b60e-8d813efcf1da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:02.155857 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6fbe2abc-46f3-4e3f-bf5f-c7414f357335 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:02.156355 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6fbe2abc-46f3-4e3f-bf5f-c7414f357335 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:02.162527 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fbe2abc-46f3-4e3f-bf5f-c7414f357335 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:02.162999 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fbe2abc-46f3-4e3f-bf5f-c7414f357335 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:02.163744 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fbe2abc-46f3-4e3f-bf5f-c7414f357335 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:02.164341 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fbe2abc-46f3-4e3f-bf5f-c7414f357335 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:02.177443 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-6fbe2abc-46f3-4e3f-bf5f-c7414f357335 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6fbe2abc-46f3-4e3f-bf5f-c7414f357335 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: DELETE /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 HTTP/1.1 Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:24:02.178959 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:24:02.180691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:02.180691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:02.180691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:02.180691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:02.180691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:02.180691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:24:02.180691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:24:02.180691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:24:02.180691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:02.180691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:24:02.180691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:24:02.180691 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '72b33cdf-def8-4dff-a771-d3e795fa0c27'} Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:02.181557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:24:02.183012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.184621 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6fbe2abc-46f3-4e3f-bf5f-c7414f357335 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 404 to user: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:02.184621 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6fbe2abc-46f3-4e3f-bf5f-c7414f357335 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 404 len: 111 microversion: 2.1 time: 0.028421 Jun 28 03:24:02.184621 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 377/752] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:24:02 2022] DELETE /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:02.188868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-283b0d8f-98e2-4aba-82a0-9220d8da972a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:02.189495 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-283b0d8f-98e2-4aba-82a0-9220d8da972a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: 72b33cdf-def8-4dff-a771-d3e795fa0c27] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:02.195584 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-283b0d8f-98e2-4aba-82a0-9220d8da972a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:02.196020 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-283b0d8f-98e2-4aba-82a0-9220d8da972a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:02.196867 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-283b0d8f-98e2-4aba-82a0-9220d8da972a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:02.197291 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-283b0d8f-98e2-4aba-82a0-9220d8da972a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:02.210485 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-283b0d8f-98e2-4aba-82a0-9220d8da972a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-283b0d8f-98e2-4aba-82a0-9220d8da972a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 HTTP/1.1 Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:24:02.212094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:24:02.213729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:02.213729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:02.213729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:02.213729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:02.213729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:02.213729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:24:02.213729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:24:02.213729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:24:02.213729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:02.213729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:24:02.213729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:24:02.213729 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '72b33cdf-def8-4dff-a771-d3e795fa0c27'} Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:02.214801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. Jun 28 03:24:02.216555 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:02.218071 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-283b0d8f-98e2-4aba-82a0-9220d8da972a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 404 to user: Instance 72b33cdf-def8-4dff-a771-d3e795fa0c27 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:02.218071 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-283b0d8f-98e2-4aba-82a0-9220d8da972a tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27" status: 404 len: 111 microversion: 2.1 time: 0.028389 Jun 28 03:24:02.218071 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 376/753] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:02 2022] GET /compute/v2.1/servers/72b33cdf-def8-4dff-a771-d3e795fa0c27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:03.351836 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-306dbce9-d6c9-4d67-a73f-c6603a5298e2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:03.353661 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-306dbce9-d6c9-4d67-a73f-c6603a5298e2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:03.360932 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-306dbce9-d6c9-4d67-a73f-c6603a5298e2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:03.361366 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-306dbce9-d6c9-4d67-a73f-c6603a5298e2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:03.362161 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-306dbce9-d6c9-4d67-a73f-c6603a5298e2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:03.362590 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-306dbce9-d6c9-4d67-a73f-c6603a5298e2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:03.376801 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-306dbce9-d6c9-4d67-a73f-c6603a5298e2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-306dbce9-d6c9-4d67-a73f-c6603a5298e2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: DELETE /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e HTTP/1.1 Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:24:03.378323 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:24:03.379815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:03.379815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:03.379815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:03.379815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:03.379815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:03.379815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:24:03.379815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:24:03.379815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:24:03.379815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:03.379815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:24:03.379815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:24:03.379815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': 'c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e'} Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:03.380688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:24:03.381962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:03.383133 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-306dbce9-d6c9-4d67-a73f-c6603a5298e2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 404 to user: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:03.383133 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-306dbce9-d6c9-4d67-a73f-c6603a5298e2 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 404 len: 111 microversion: 2.1 time: 0.032039 Jun 28 03:24:03.383133 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 378/754] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:24:03 2022] DELETE /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:03.388676 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fb73b591-3f86-4e88-aa29-ae3e5c2b85c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:03.389276 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fb73b591-3f86-4e88-aa29-ae3e5c2b85c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] [instance: c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:03.395698 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fb73b591-3f86-4e88-aa29-ae3e5c2b85c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:03.396140 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fb73b591-3f86-4e88-aa29-ae3e5c2b85c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:03.396922 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fb73b591-3f86-4e88-aa29-ae3e5c2b85c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:03.397349 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fb73b591-3f86-4e88-aa29-ae3e5c2b85c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:03.411789 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-fb73b591-3f86-4e88-aa29-ae3e5c2b85c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] HTTP exception thrown: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fb73b591-3f86-4e88-aa29-ae3e5c2b85c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Request method failure captured: Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e HTTP/1.1 Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunLqtrN8V3--uZV69dPJ9Q4zQvpMMzhxyMkBXSG3KotANkeupeT7PK48K54PtPVLVQUKAE8ksyo1R8ZIwz6aSxjXWmoNlLN7tonjMINUpd88u0Gjhdm3_-s2uRMuCc6ZdG4kJ1yoo82ru9cQ6MtxG1v0gW2ACI_s9-KkWjw5_N9VLFg Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:24:03.413363 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:24:03.414756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_63f6b05085584fd5beecbe54c7251525", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/63f6b05085584fd5beecbe54c7251525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:03.414756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:03.414756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 63f6b05085584fd5beecbe54c7251525 Jun 28 03:24:03.414756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-478302071 Jun 28 03:24:03.414756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:03.414756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:24:03.414756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:24:03.414756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 4181737f6f2348d2906aea642b8598f7 Jun 28 03:24:03.414756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-478302071-project Jun 28 03:24:03.414756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:24:03.414756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:24:03.414756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': 'c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e'} Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:03.416206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. Jun 28 03:24:03.417886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:03.419770 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fb73b591-3f86-4e88-aa29-ae3e5c2b85c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] Returning 404 to user: Instance c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:03.419770 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fb73b591-3f86-4e88-aa29-ae3e5c2b85c1 tempest-AttachVolumeNegativeTest-478302071 tempest-AttachVolumeNegativeTest-478302071-project] 10.222.0.44 "GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e" status: 404 len: 111 microversion: 2.1 time: 0.030064 Jun 28 03:24:03.419770 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 377/755] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:03 2022] GET /compute/v2.1/servers/c78d0b83-8de0-4277-9da7-e2fb6a6e1e3e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:24:10.245077 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-237435fd-ee52-4cca-9b0e-a82cd7a80341 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:10.245994 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-237435fd-ee52-4cca-9b0e-a82cd7a80341 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:10.253037 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-237435fd-ee52-4cca-9b0e-a82cd7a80341 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:10.253475 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-237435fd-ee52-4cca-9b0e-a82cd7a80341 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:10.254238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-237435fd-ee52-4cca-9b0e-a82cd7a80341 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:10.254662 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-237435fd-ee52-4cca-9b0e-a82cd7a80341 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:10.285495 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-237435fd-ee52-4cca-9b0e-a82cd7a80341 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043954 Jun 28 03:24:10.285998 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 379/756] 10.222.0.44 () {60 vars in 1342 bytes} [Tue Jun 28 03:24:10 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:24:10.343276 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-81657dc1-9133-47fd-8728-9ef39473b69d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:10.343799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-81657dc1-9133-47fd-8728-9ef39473b69d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:10.350527 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81657dc1-9133-47fd-8728-9ef39473b69d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:10.350964 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81657dc1-9133-47fd-8728-9ef39473b69d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:10.351711 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81657dc1-9133-47fd-8728-9ef39473b69d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:10.352143 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81657dc1-9133-47fd-8728-9ef39473b69d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:10.377876 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-81657dc1-9133-47fd-8728-9ef39473b69d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:24:10.457511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-81657dc1-9133-47fd-8728-9ef39473b69d tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 204 len: 0 microversion: 2.20 time: 0.117759 Jun 28 03:24:10.458185 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 378/757] 10.222.0.44 () {60 vars in 1279 bytes} [Tue Jun 28 03:24:10 2022] DELETE /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 28 03:24:10.467256 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-255bc93b-6773-4f49-a5c1-f2a1c028a132 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:10.468841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-255bc93b-6773-4f49-a5c1-f2a1c028a132 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:10.476401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-255bc93b-6773-4f49-a5c1-f2a1c028a132 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:10.476709 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-255bc93b-6773-4f49-a5c1-f2a1c028a132 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:10.477696 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-255bc93b-6773-4f49-a5c1-f2a1c028a132 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:10.478533 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-255bc93b-6773-4f49-a5c1-f2a1c028a132 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:10.621646 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-255bc93b-6773-4f49-a5c1-f2a1c028a132 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:10.629794 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-255bc93b-6773-4f49-a5c1-f2a1c028a132 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:10.631234 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-255bc93b-6773-4f49-a5c1-f2a1c028a132 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:10.632408 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-255bc93b-6773-4f49-a5c1-f2a1c028a132 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1723 microversion: 2.20 time: 0.169639 Jun 28 03:24:10.632964 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 380/758] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:24:10 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:24:11.651797 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4aa01d0f-2ac4-485a-a26f-39b3207a03e5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:11.652577 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4aa01d0f-2ac4-485a-a26f-39b3207a03e5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:11.659385 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4aa01d0f-2ac4-485a-a26f-39b3207a03e5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:11.659820 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4aa01d0f-2ac4-485a-a26f-39b3207a03e5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:11.660600 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4aa01d0f-2ac4-485a-a26f-39b3207a03e5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:11.661027 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4aa01d0f-2ac4-485a-a26f-39b3207a03e5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:11.793661 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4aa01d0f-2ac4-485a-a26f-39b3207a03e5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:11.801841 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4aa01d0f-2ac4-485a-a26f-39b3207a03e5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:11.803281 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4aa01d0f-2ac4-485a-a26f-39b3207a03e5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:11.804460 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4aa01d0f-2ac4-485a-a26f-39b3207a03e5 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1723 microversion: 2.20 time: 0.157359 Jun 28 03:24:11.805022 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 379/759] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:24:11 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:24:12.824461 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-aa266871-0fe3-47ea-b210-49c208b237ac tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:12.825184 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-aa266871-0fe3-47ea-b210-49c208b237ac tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:12.832092 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aa266871-0fe3-47ea-b210-49c208b237ac tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:12.833139 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aa266871-0fe3-47ea-b210-49c208b237ac tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:12.833931 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aa266871-0fe3-47ea-b210-49c208b237ac tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:12.834363 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-aa266871-0fe3-47ea-b210-49c208b237ac tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:12.923391 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-aa266871-0fe3-47ea-b210-49c208b237ac tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:12.938761 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-aa266871-0fe3-47ea-b210-49c208b237ac tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:12.941106 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-aa266871-0fe3-47ea-b210-49c208b237ac tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f5f5b39c16f4cb38c12c33252786cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e47b6f7a96c46dfa9906912efb7f265', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:12.942363 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-aa266871-0fe3-47ea-b210-49c208b237ac tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 200 len: 1655 microversion: 2.20 time: 0.122535 Jun 28 03:24:12.952710 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 381/760] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:24:12 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 1655 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 28 03:24:13.000104 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-86f2d8cc-ff27-43b5-9cc7-98b0921999f7 req-20976937-21a0-413e-8496-98f1ba6b51cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e97b7a4-a1fb-4757-8d7f-d16a84c5561c", "name": "network-vif-deleted", "tag": "02235355-6547-49bd-a247-cc3176e99f9e"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:24:13.010710 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-86f2d8cc-ff27-43b5-9cc7-98b0921999f7 req-20976937-21a0-413e-8496-98f1ba6b51cf service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:13.011343 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-86f2d8cc-ff27-43b5-9cc7-98b0921999f7 req-20976937-21a0-413e-8496-98f1ba6b51cf service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:13.034186 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-86f2d8cc-ff27-43b5-9cc7-98b0921999f7 req-20976937-21a0-413e-8496-98f1ba6b51cf service nova] Creating event network-vif-deleted:02235355-6547-49bd-a247-cc3176e99f9e for instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c on hv-cinder-84684 Jun 28 03:24:13.044866 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-86f2d8cc-ff27-43b5-9cc7-98b0921999f7 req-20976937-21a0-413e-8496-98f1ba6b51cf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047865 Jun 28 03:24:13.046044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 380/761] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:24:13.963771 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d10641b0-4a82-4cb9-9935-c2d45944309e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:13.966084 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d10641b0-4a82-4cb9-9935-c2d45944309e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:13.973697 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d10641b0-4a82-4cb9-9935-c2d45944309e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:13.974137 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d10641b0-4a82-4cb9-9935-c2d45944309e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:13.974933 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d10641b0-4a82-4cb9-9935-c2d45944309e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:13.975447 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d10641b0-4a82-4cb9-9935-c2d45944309e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:13.993606 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-d10641b0-4a82-4cb9-9935-c2d45944309e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] HTTP exception thrown: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d10641b0-4a82-4cb9-9935-c2d45944309e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Request method failure captured: Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c HTTP/1.1 Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLfqfVekJS5QVqlpWPnizndbu__ZBW53gNh0Y4alUFgbCvoYRhPbitQMxllc39OV1xmWLb4xvtZJmj1i6_NiJJP5dVTYX7s-upmgiWiht2pPcKIQ4gIZEFUu_lhFHWuWqcGOCSf6fXS4zxLraTg2tVzkOha6QxezjvHnXBSibYJNEU Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 9e47b6f7a96c46dfa9906912efb7f265 Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:24:13.995189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:24:13.996692 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9e47b6f7a96c46dfa9906912efb7f265", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:13.996692 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:13.996692 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 9e47b6f7a96c46dfa9906912efb7f265 Jun 28 03:24:13.996692 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:13.996692 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-AttachVolumeShelveTestJSON-1525698805-project Jun 28 03:24:13.996692 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:24:13.996692 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:24:13.996692 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 1f5f5b39c16f4cb38c12c33252786cc5 Jun 28 03:24:13.996692 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1525698805-project Jun 28 03:24:13.996692 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:24:13.996692 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:13.996692 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '2e97b7a4-a1fb-4757-8d7f-d16a84c5561c'} Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:13.998102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:13.999674 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:14.001251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d10641b0-4a82-4cb9-9935-c2d45944309e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Returning 404 to user: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:14.001251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d10641b0-4a82-4cb9-9935-c2d45944309e tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 404 len: 111 microversion: 2.20 time: 0.037948 Jun 28 03:24:14.001251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 382/762] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:24:13 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 03:24:14.010203 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-54f87684-bacb-44d1-a6e6-548dd311ba10 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '.version_select at 0x7f53f1af4e50>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:14.030497 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-54f87684-bacb-44d1-a6e6-548dd311ba10 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-436932162" status: 204 len: 0 microversion: 2.20 time: 0.025713 Jun 28 03:24:14.031295 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 381/763] 10.222.0.44 () {60 vars in 1258 bytes} [Tue Jun 28 03:24:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-436932162 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 28 03:24:15.884013 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-49dec622-70d1-4429-bb28-13cff67dfafe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:15.884564 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-49dec622-70d1-4429-bb28-13cff67dfafe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:15.891264 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-49dec622-70d1-4429-bb28-13cff67dfafe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:15.891702 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-49dec622-70d1-4429-bb28-13cff67dfafe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:15.892601 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-49dec622-70d1-4429-bb28-13cff67dfafe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:15.893032 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-49dec622-70d1-4429-bb28-13cff67dfafe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-49dec622-70d1-4429-bb28-13cff67dfafe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] HTTP exception thrown: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-49dec622-70d1-4429-bb28-13cff67dfafe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Request method failure captured: Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: DELETE /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c HTTP/1.1 Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLfqfVekJS5QVqlpWPnizndbu__ZBW53gNh0Y4alUFgbCvoYRhPbitQMxllc39OV1xmWLb4xvtZJmj1i6_NiJJP5dVTYX7s-upmgiWiht2pPcKIQ4gIZEFUu_lhFHWuWqcGOCSf6fXS4zxLraTg2tVzkOha6QxezjvHnXBSibYJNEU Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 9e47b6f7a96c46dfa9906912efb7f265 Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:24:15.909575 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:24:15.911213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9e47b6f7a96c46dfa9906912efb7f265", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:15.911213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:15.911213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 9e47b6f7a96c46dfa9906912efb7f265 Jun 28 03:24:15.911213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:15.911213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-AttachVolumeShelveTestJSON-1525698805-project Jun 28 03:24:15.911213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:24:15.911213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:24:15.911213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 1f5f5b39c16f4cb38c12c33252786cc5 Jun 28 03:24:15.911213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1525698805-project Jun 28 03:24:15.911213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:24:15.911213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:15.911213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '2e97b7a4-a1fb-4757-8d7f-d16a84c5561c'} Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:15.912412 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:15.914386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:15.915732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-49dec622-70d1-4429-bb28-13cff67dfafe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Returning 404 to user: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:15.915732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-49dec622-70d1-4429-bb28-13cff67dfafe tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 404 len: 111 microversion: 2.20 time: 0.029802 Jun 28 03:24:15.915732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 383/764] 10.222.0.44 () {60 vars in 1279 bytes} [Tue Jun 28 03:24:15 2022] DELETE /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 03:24:15.918466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-918a7415-fc55-4334-88ba-1b96d0d63b86 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:15.919144 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-918a7415-fc55-4334-88ba-1b96d0d63b86 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:15.926489 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-918a7415-fc55-4334-88ba-1b96d0d63b86 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:15.926934 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-918a7415-fc55-4334-88ba-1b96d0d63b86 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:15.927725 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-918a7415-fc55-4334-88ba-1b96d0d63b86 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:15.928665 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-918a7415-fc55-4334-88ba-1b96d0d63b86 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:15.942023 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-918a7415-fc55-4334-88ba-1b96d0d63b86 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] HTTP exception thrown: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-918a7415-fc55-4334-88ba-1b96d0d63b86 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Request method failure captured: Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c HTTP/1.1 Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunLfqfVekJS5QVqlpWPnizndbu__ZBW53gNh0Y4alUFgbCvoYRhPbitQMxllc39OV1xmWLb4xvtZJmj1i6_NiJJP5dVTYX7s-upmgiWiht2pPcKIQ4gIZEFUu_lhFHWuWqcGOCSf6fXS4zxLraTg2tVzkOha6QxezjvHnXBSibYJNEU Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 9e47b6f7a96c46dfa9906912efb7f265 Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:24:15.943662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:24:15.948821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9e47b6f7a96c46dfa9906912efb7f265", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:15.948821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:15.948821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 9e47b6f7a96c46dfa9906912efb7f265 Jun 28 03:24:15.948821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:15.948821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeShelveTestJSON-1525698805-project Jun 28 03:24:15.948821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:24:15.948821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:24:15.948821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 1f5f5b39c16f4cb38c12c33252786cc5 Jun 28 03:24:15.948821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1525698805-project Jun 28 03:24:15.948821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:24:15.948821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:15.948821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '2e97b7a4-a1fb-4757-8d7f-d16a84c5561c'} Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:15.949799 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. Jun 28 03:24:15.951273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:15.952649 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-918a7415-fc55-4334-88ba-1b96d0d63b86 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Returning 404 to user: Instance 2e97b7a4-a1fb-4757-8d7f-d16a84c5561c could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:15.952649 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-918a7415-fc55-4334-88ba-1b96d0d63b86 tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c" status: 404 len: 111 microversion: 2.20 time: 0.030512 Jun 28 03:24:15.952649 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 382/765] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:24:15 2022] GET /compute/v2.1/servers/2e97b7a4-a1fb-4757-8d7f-d16a84c5561c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 03:24:17.110057 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-485ba45e-1d99-47ff-a891-07ddfe2bd8ff tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:17.110746 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-485ba45e-1d99-47ff-a891-07ddfe2bd8ff tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:17.117286 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-485ba45e-1d99-47ff-a891-07ddfe2bd8ff tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:17.117831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-485ba45e-1d99-47ff-a891-07ddfe2bd8ff tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:17.118649 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-485ba45e-1d99-47ff-a891-07ddfe2bd8ff tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:17.119151 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-485ba45e-1d99-47ff-a891-07ddfe2bd8ff tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:17.132762 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-485ba45e-1d99-47ff-a891-07ddfe2bd8ff tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] HTTP exception thrown: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-485ba45e-1d99-47ff-a891-07ddfe2bd8ff tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Request method failure captured: Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: DELETE /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 HTTP/1.1 Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunLfqfVekJS5QVqlpWPnizndbu__ZBW53gNh0Y4alUFgbCvoYRhPbitQMxllc39OV1xmWLb4xvtZJmj1i6_NiJJP5dVTYX7s-upmgiWiht2pPcKIQ4gIZEFUu_lhFHWuWqcGOCSf6fXS4zxLraTg2tVzkOha6QxezjvHnXBSibYJNEU Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 9e47b6f7a96c46dfa9906912efb7f265 Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:24:17.134435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:24:17.136317 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9e47b6f7a96c46dfa9906912efb7f265", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:17.136317 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:17.136317 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 9e47b6f7a96c46dfa9906912efb7f265 Jun 28 03:24:17.136317 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:17.136317 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-AttachVolumeShelveTestJSON-1525698805-project Jun 28 03:24:17.136317 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:24:17.136317 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:24:17.136317 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 1f5f5b39c16f4cb38c12c33252786cc5 Jun 28 03:24:17.136317 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1525698805-project Jun 28 03:24:17.136317 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:24:17.136317 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:24:17.136317 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '62f3fd86-9d6c-4d2e-8997-579c77adc3f0'} Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:17.137224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:24:17.138990 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:24:17.140743 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-485ba45e-1d99-47ff-a891-07ddfe2bd8ff tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Returning 404 to user: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:17.140743 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-485ba45e-1d99-47ff-a891-07ddfe2bd8ff tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "DELETE /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 404 len: 111 microversion: 2.20 time: 0.030194 Jun 28 03:24:17.140743 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 384/766] 10.222.0.44 () {60 vars in 1279 bytes} [Tue Jun 28 03:24:17 2022] DELETE /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 03:24:17.146538 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-75e2d5a3-e7ab-443d-96be-c611017621eb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:17.147143 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-75e2d5a3-e7ab-443d-96be-c611017621eb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] [instance: 62f3fd86-9d6c-4d2e-8997-579c77adc3f0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:17.157827 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-75e2d5a3-e7ab-443d-96be-c611017621eb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:17.158270 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-75e2d5a3-e7ab-443d-96be-c611017621eb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:17.159028 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-75e2d5a3-e7ab-443d-96be-c611017621eb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:17.159453 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-75e2d5a3-e7ab-443d-96be-c611017621eb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:17.173315 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-75e2d5a3-e7ab-443d-96be-c611017621eb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] HTTP exception thrown: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-75e2d5a3-e7ab-443d-96be-c611017621eb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Request method failure captured: Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 HTTP/1.1 Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunLfqfVekJS5QVqlpWPnizndbu__ZBW53gNh0Y4alUFgbCvoYRhPbitQMxllc39OV1xmWLb4xvtZJmj1i6_NiJJP5dVTYX7s-upmgiWiht2pPcKIQ4gIZEFUu_lhFHWuWqcGOCSf6fXS4zxLraTg2tVzkOha6QxezjvHnXBSibYJNEU Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Openstack-Nova-Api-Version: 2.20 Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 9e47b6f7a96c46dfa9906912efb7f265 Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:24:17.174806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:24:17.176458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9e47b6f7a96c46dfa9906912efb7f265", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9e47b6f7a96c46dfa9906912efb7f265"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:24:17.176458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:17.176458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 9e47b6f7a96c46dfa9906912efb7f265 Jun 28 03:24:17.176458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1525698805 Jun 28 03:24:17.176458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeShelveTestJSON-1525698805-project Jun 28 03:24:17.176458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:24:17.176458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:24:17.176458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 1f5f5b39c16f4cb38c12c33252786cc5 Jun 28 03:24:17.176458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1525698805-project Jun 28 03:24:17.176458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:24:17.176458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:24:17.176458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '62f3fd86-9d6c-4d2e-8997-579c77adc3f0'} Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:24:17.177245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. Jun 28 03:24:17.178722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:24:17.179985 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-75e2d5a3-e7ab-443d-96be-c611017621eb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] Returning 404 to user: Instance 62f3fd86-9d6c-4d2e-8997-579c77adc3f0 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:24:17.179985 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-75e2d5a3-e7ab-443d-96be-c611017621eb tempest-AttachVolumeShelveTestJSON-1525698805 tempest-AttachVolumeShelveTestJSON-1525698805-project] 10.222.0.44 "GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0" status: 404 len: 111 microversion: 2.20 time: 0.033908 Jun 28 03:24:17.179985 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 383/767] 10.222.0.44 () {60 vars in 1276 bytes} [Tue Jun 28 03:24:17 2022] GET /compute/v2.1/servers/62f3fd86-9d6c-4d2e-8997-579c77adc3f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 28 03:24:27.104299 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-19a29e70-60c6-4e17-8607-f21c5aae597e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Action: 'create', calling method: .version_select at 0x7f53f1a6da60>, body: {"keypair": {"name": "tempest-keypair-1221186413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWwDBiaU7CS3Umia1nSDQEsWAQc2lDwdmpucG9urdwypujz6L1rCmJ5lBN5kBq3MI+pz+T6rWGF7wkRfBEb/9ybxlxcbsSZWj+/fdeabNrpUXiHAIofpjy5xY6xAmwpOQ=="}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:24:27.109250 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:27.123813 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-19a29e70-60c6-4e17-8607-f21c5aae597e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Getting quotas for project d4fae3b890884f28a70d0ccc855d5365. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:24:27.125403 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=48 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:27.129815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-19a29e70-60c6-4e17-8607-f21c5aae597e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Getting quotas for user 5efee06a99e04a349f314b7c6c44837b and project d4fae3b890884f28a70d0ccc855d5365. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:24:27.142888 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR oslo.messaging._drivers.impl_rabbit [None req-19a29e70-60c6-4e17-8607-f21c5aae597e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [7abfcc25-68e4-4887-b965-5b65bd5b71f1] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 28 03:24:28.152252 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO oslo.messaging._drivers.impl_rabbit [None req-19a29e70-60c6-4e17-8607-f21c5aae597e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [7abfcc25-68e4-4887-b965-5b65bd5b71f1] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 48050. Jun 28 03:24:28.170281 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-19a29e70-60c6-4e17-8607-f21c5aae597e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.381795 Jun 28 03:24:28.170877 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 385/768] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 28 03:24:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:24:29.726243 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1876254820", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a0b7c7d-030f-4368-b16f-203c59ecfcfc"}], "security_groups": [{"name": "tempest-securitygroup--1848438108"}], "key_name": "tempest-keypair-1221186413", "user_data": "}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:24:29.736918 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:29.738689 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:29.880182 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] validate_networks() for [('4a0b7c7d-030f-4368-b16f-203c59ecfcfc', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:24:30.701577 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:24:30.702171 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:24:30.702653 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:24:30.703120 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:24:30.703472 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:24:30.720434 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:30.721018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:30.722958 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:30.723410 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:30.750574 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Getting quotas for project d4fae3b890884f28a70d0ccc855d5365. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:24:30.756860 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Getting quotas for user 5efee06a99e04a349f314b7c6c44837b and project d4fae3b890884f28a70d0ccc855d5365. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:24:30.778475 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:24:30.781076 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:24:30.846316 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-972d8f34-519d-4b74-9804-08dcc3051f1c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.125313 Jun 28 03:24:30.847321 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 384/769] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:24:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:24:30.864348 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-5fe7abad-e0e2-4437-88b8-9a932968e165 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:30.866316 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-5fe7abad-e0e2-4437-88b8-9a932968e165 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:31.281377 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-5fe7abad-e0e2-4437-88b8-9a932968e165 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:31.289239 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-5fe7abad-e0e2-4437-88b8-9a932968e165 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1238 microversion: 2.1 time: 0.432638 Jun 28 03:24:31.290227 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 386/770] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:30 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1238 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:24:32.307928 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e6aef0da-82c2-4796-9737-104efac3e765 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:32.309085 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e6aef0da-82c2-4796-9737-104efac3e765 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:32.318060 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e6aef0da-82c2-4796-9737-104efac3e765 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:32.318506 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e6aef0da-82c2-4796-9737-104efac3e765 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:32.319266 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e6aef0da-82c2-4796-9737-104efac3e765 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:32.319720 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e6aef0da-82c2-4796-9737-104efac3e765 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:32.411252 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e6aef0da-82c2-4796-9737-104efac3e765 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:32.420802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e6aef0da-82c2-4796-9737-104efac3e765 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1296 microversion: 2.1 time: 0.117550 Jun 28 03:24:32.426885 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 385/771] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:32 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1296 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:24:33.439118 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f89e7a3a-4b35-4e8b-a886-5fac6bc86feb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:33.440797 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f89e7a3a-4b35-4e8b-a886-5fac6bc86feb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:33.459921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f89e7a3a-4b35-4e8b-a886-5fac6bc86feb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:33.462581 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f89e7a3a-4b35-4e8b-a886-5fac6bc86feb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:33.464028 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f89e7a3a-4b35-4e8b-a886-5fac6bc86feb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:33.464697 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f89e7a3a-4b35-4e8b-a886-5fac6bc86feb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:33.707062 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-f89e7a3a-4b35-4e8b-a886-5fac6bc86feb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:33.720815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f89e7a3a-4b35-4e8b-a886-5fac6bc86feb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1364 microversion: 2.1 time: 0.284584 Jun 28 03:24:33.721903 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 387/772] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:33 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:24:34.149596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-293e4e8c-ff7c-479c-859f-4f5d5e9c119c req-c03495c1-8cd0-4569-9f83-889aa82e3ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785c405e-c17b-4e21-b51e-f645dd26f9b9", "tag": "b7f197d8-65db-4b70-b5fc-1416f37de7ba"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:24:34.162551 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-293e4e8c-ff7c-479c-859f-4f5d5e9c119c req-c03495c1-8cd0-4569-9f83-889aa82e3ee0 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:34.163343 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-293e4e8c-ff7c-479c-859f-4f5d5e9c119c req-c03495c1-8cd0-4569-9f83-889aa82e3ee0 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:34.180163 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-293e4e8c-ff7c-479c-859f-4f5d5e9c119c req-c03495c1-8cd0-4569-9f83-889aa82e3ee0 service nova] Creating event network-changed:b7f197d8-65db-4b70-b5fc-1416f37de7ba for instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 on hv-cinder-84684 Jun 28 03:24:34.185556 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-293e4e8c-ff7c-479c-859f-4f5d5e9c119c req-c03495c1-8cd0-4569-9f83-889aa82e3ee0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040006 Jun 28 03:24:34.186843 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 386/773] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:24:34.738935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-924273ef-787f-43a0-b949-42be7708cc4b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:34.740687 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-924273ef-787f-43a0-b949-42be7708cc4b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:34.748632 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-924273ef-787f-43a0-b949-42be7708cc4b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:34.749385 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-924273ef-787f-43a0-b949-42be7708cc4b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:34.750352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-924273ef-787f-43a0-b949-42be7708cc4b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:34.750825 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-924273ef-787f-43a0-b949-42be7708cc4b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:34.922158 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-924273ef-787f-43a0-b949-42be7708cc4b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:34.929831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-924273ef-787f-43a0-b949-42be7708cc4b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1364 microversion: 2.1 time: 0.194918 Jun 28 03:24:34.930392 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 388/774] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:34 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:24:35.948279 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d5791e5e-4ae5-429f-bf2c-5bf9817b8446 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:35.949592 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d5791e5e-4ae5-429f-bf2c-5bf9817b8446 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:35.956195 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d5791e5e-4ae5-429f-bf2c-5bf9817b8446 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:35.956836 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d5791e5e-4ae5-429f-bf2c-5bf9817b8446 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:35.957743 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d5791e5e-4ae5-429f-bf2c-5bf9817b8446 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:35.958320 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d5791e5e-4ae5-429f-bf2c-5bf9817b8446 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:36.239220 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d5791e5e-4ae5-429f-bf2c-5bf9817b8446 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:36.254794 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d5791e5e-4ae5-429f-bf2c-5bf9817b8446 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1364 microversion: 2.1 time: 0.311454 Jun 28 03:24:36.256311 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 387/775] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:35 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1364 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:24:37.272282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-0c5a3c02-4c4d-4cde-beea-8b475749e32a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:37.273007 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-0c5a3c02-4c4d-4cde-beea-8b475749e32a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:37.283972 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0c5a3c02-4c4d-4cde-beea-8b475749e32a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:37.284950 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0c5a3c02-4c4d-4cde-beea-8b475749e32a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:37.287429 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0c5a3c02-4c4d-4cde-beea-8b475749e32a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:37.287866 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0c5a3c02-4c4d-4cde-beea-8b475749e32a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:37.472525 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-0c5a3c02-4c4d-4cde-beea-8b475749e32a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:37.482817 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-0c5a3c02-4c4d-4cde-beea-8b475749e32a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1364 microversion: 2.1 time: 0.214542 Jun 28 03:24:37.483740 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 389/776] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:37 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:24:38.505207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f8cc042c-e3c8-44a6-a7ea-5d2c2f79e4f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:38.507306 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f8cc042c-e3c8-44a6-a7ea-5d2c2f79e4f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:38.514737 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8cc042c-e3c8-44a6-a7ea-5d2c2f79e4f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:38.515718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8cc042c-e3c8-44a6-a7ea-5d2c2f79e4f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:38.516765 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8cc042c-e3c8-44a6-a7ea-5d2c2f79e4f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:38.517426 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8cc042c-e3c8-44a6-a7ea-5d2c2f79e4f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:38.749260 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f8cc042c-e3c8-44a6-a7ea-5d2c2f79e4f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:38.759936 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f8cc042c-e3c8-44a6-a7ea-5d2c2f79e4f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1364 microversion: 2.1 time: 0.258655 Jun 28 03:24:38.771625 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 388/777] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:38 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:24:39.786024 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-dc3b1d5a-d651-4434-8e92-b8250f8fc692 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:39.786622 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-dc3b1d5a-d651-4434-8e92-b8250f8fc692 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:39.793988 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dc3b1d5a-d651-4434-8e92-b8250f8fc692 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:39.794714 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dc3b1d5a-d651-4434-8e92-b8250f8fc692 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:39.795666 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dc3b1d5a-d651-4434-8e92-b8250f8fc692 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:39.796307 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dc3b1d5a-d651-4434-8e92-b8250f8fc692 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:40.393187 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-dc3b1d5a-d651-4434-8e92-b8250f8fc692 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:40.406101 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-dc3b1d5a-d651-4434-8e92-b8250f8fc692 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1364 microversion: 2.1 time: 0.623840 Jun 28 03:24:40.407014 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 390/778] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:39 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1364 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:24:41.423884 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-18bd76c5-65fa-48c3-b2fa-49ac69260b91 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:41.424514 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-18bd76c5-65fa-48c3-b2fa-49ac69260b91 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:41.427384 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:41.429335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:41.437576 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-18bd76c5-65fa-48c3-b2fa-49ac69260b91 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:41.439165 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-18bd76c5-65fa-48c3-b2fa-49ac69260b91 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:41.440138 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-18bd76c5-65fa-48c3-b2fa-49ac69260b91 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:41.440812 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-18bd76c5-65fa-48c3-b2fa-49ac69260b91 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:41.640081 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-18bd76c5-65fa-48c3-b2fa-49ac69260b91 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:41.655068 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-18bd76c5-65fa-48c3-b2fa-49ac69260b91 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1364 microversion: 2.1 time: 0.235524 Jun 28 03:24:41.656611 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 389/779] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:41 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:24:41.793789 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-e78e7fdc-b767-434c-9b43-a0a66eebce68 req-cfb6219b-5663-464b-b4cc-d3fb493b6d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785c405e-c17b-4e21-b51e-f645dd26f9b9", "name": "network-vif-plugged", "status": "completed", "tag": "b7f197d8-65db-4b70-b5fc-1416f37de7ba"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:24:41.806448 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=6 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:24:41.809424 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-e78e7fdc-b767-434c-9b43-a0a66eebce68 req-cfb6219b-5663-464b-b4cc-d3fb493b6d42 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:41.810195 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-e78e7fdc-b767-434c-9b43-a0a66eebce68 req-cfb6219b-5663-464b-b4cc-d3fb493b6d42 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:41.826856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-e78e7fdc-b767-434c-9b43-a0a66eebce68 req-cfb6219b-5663-464b-b4cc-d3fb493b6d42 service nova] Creating event network-vif-plugged:b7f197d8-65db-4b70-b5fc-1416f37de7ba for instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 on hv-cinder-84684 Jun 28 03:24:41.835031 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-e78e7fdc-b767-434c-9b43-a0a66eebce68 req-cfb6219b-5663-464b-b4cc-d3fb493b6d42 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049198 Jun 28 03:24:41.836667 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 391/780] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:24:42.673261 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-887df14d-a83c-4a0a-a3df-73f3ae0a6d2e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:42.673840 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-887df14d-a83c-4a0a-a3df-73f3ae0a6d2e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:42.680833 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-887df14d-a83c-4a0a-a3df-73f3ae0a6d2e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:42.681520 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-887df14d-a83c-4a0a-a3df-73f3ae0a6d2e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:42.682439 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-887df14d-a83c-4a0a-a3df-73f3ae0a6d2e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:42.683466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-887df14d-a83c-4a0a-a3df-73f3ae0a6d2e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:42.841384 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-887df14d-a83c-4a0a-a3df-73f3ae0a6d2e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:42.854038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-887df14d-a83c-4a0a-a3df-73f3ae0a6d2e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1364 microversion: 2.1 time: 0.184158 Jun 28 03:24:42.854848 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 390/781] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:42 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:24:42.884940 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6561c85a-babb-4a30-bef4-475732025bd8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Action: 'create', calling method: .version_select at 0x7f53f1a32e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1536016975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACiShnGeNWgfkL63pMDDZ18vU8ZJxGkQwaeJXPkBzS9FrVQj1ElYnbk6jBtOriyqeeufkNIVl2LTfFNlLEP2Dc0jFj/P5veiBbq5BsxJW0I2Hvvzy434VPXOdA/1XSYtA=="}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:24:42.899024 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-6561c85a-babb-4a30-bef4-475732025bd8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Getting quotas for project cc2d6ae6d1f74852b9b51d970d19d0df. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:24:42.903183 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-6561c85a-babb-4a30-bef4-475732025bd8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Getting quotas for user 3480ec26f30343e58a5e7b5329cb2cce and project cc2d6ae6d1f74852b9b51d970d19d0df. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:24:42.926684 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6561c85a-babb-4a30-bef4-475732025bd8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.237653 Jun 28 03:24:42.927336 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 392/782] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 28 03:24:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:24:43.871198 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e31057e2-354a-48c9-9941-3a89d23accbc tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:43.871716 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e31057e2-354a-48c9-9941-3a89d23accbc tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:43.889106 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e31057e2-354a-48c9-9941-3a89d23accbc tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:43.889623 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e31057e2-354a-48c9-9941-3a89d23accbc tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:43.890451 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e31057e2-354a-48c9-9941-3a89d23accbc tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:43.890879 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e31057e2-354a-48c9-9941-3a89d23accbc tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:44.082472 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e31057e2-354a-48c9-9941-3a89d23accbc tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:24:44.091762 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e31057e2-354a-48c9-9941-3a89d23accbc tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1551 microversion: 2.1 time: 0.224643 Jun 28 03:24:44.100353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 391/783] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:24:43 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1551 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:24:44.123525 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8c77f158-7a92-4e20-a4b1-570c2c9df725 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:24:44.124192 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-8c77f158-7a92-4e20-a4b1-570c2c9df725 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:24:44.139023 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c77f158-7a92-4e20-a4b1-570c2c9df725 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:44.139480 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c77f158-7a92-4e20-a4b1-570c2c9df725 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:44.140504 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c77f158-7a92-4e20-a4b1-570c2c9df725 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:44.144772 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c77f158-7a92-4e20-a4b1-570c2c9df725 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:44.244686 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-8c77f158-7a92-4e20-a4b1-570c2c9df725 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139640 Jun 28 03:24:44.245567 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 393/784] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 28 03:24:44 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:24:45.329020 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-aa639027-b54e-490c-ac9e-23a10d9805ef req-cfe17383-700d-406e-ab06-2a8763eff9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785c405e-c17b-4e21-b51e-f645dd26f9b9", "tag": "b7f197d8-65db-4b70-b5fc-1416f37de7ba"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:24:45.337777 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-aa639027-b54e-490c-ac9e-23a10d9805ef req-cfe17383-700d-406e-ab06-2a8763eff9f5 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:24:45.339056 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-aa639027-b54e-490c-ac9e-23a10d9805ef req-cfe17383-700d-406e-ab06-2a8763eff9f5 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:24:45.350677 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-aa639027-b54e-490c-ac9e-23a10d9805ef req-cfe17383-700d-406e-ab06-2a8763eff9f5 service nova] Creating event network-changed:b7f197d8-65db-4b70-b5fc-1416f37de7ba for instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 on hv-cinder-84684 Jun 28 03:24:45.356667 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-aa639027-b54e-490c-ac9e-23a10d9805ef req-cfe17383-700d-406e-ab06-2a8763eff9f5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031351 Jun 28 03:24:45.359302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 392/785] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:25:04.165186 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=4 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:04.166059 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:04.166615 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=30 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:04.170917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1439468619", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1536016975", "security_groups": [{"name": "tempest-secgroup-smoke-1125387860"}], "block_device_mapping_v2": [{"uuid": "d135ac5b-1d3d-4232-8066-7666c8fec78b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa3b8415-5dcf-451a-a58a-63fa23e098ab"}]}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:25:04.345169 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.network.neutron [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] validate_networks() for [('fa3b8415-5dcf-451a-a58a-63fa23e098ab', None, None, None, None, None)] {{(pid=117681) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:25:05.173997 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:05.176336 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=42 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:05.180584 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-708c268b-3e32-4cfe-9d6d-e4a7a336f2d8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:05.181385 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-708c268b-3e32-4cfe-9d6d-e4a7a336f2d8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:05.189265 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-708c268b-3e32-4cfe-9d6d-e4a7a336f2d8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:05.189789 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-708c268b-3e32-4cfe-9d6d-e4a7a336f2d8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:05.190614 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-708c268b-3e32-4cfe-9d6d-e4a7a336f2d8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:05.191119 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-708c268b-3e32-4cfe-9d6d-e4a7a336f2d8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:05.218068 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-708c268b-3e32-4cfe-9d6d-e4a7a336f2d8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:25:05.308511 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Flavor limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:25:05.309704 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Image limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:25:05.310202 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Flavor pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:25:05.310581 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Image pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:25:05.310987 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:25:05.318112 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-708c268b-3e32-4cfe-9d6d-e4a7a336f2d8 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "DELETE /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 204 len: 0 microversion: 2.1 time: 0.145554 Jun 28 03:25:05.323255 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 393/786] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:25:05 2022] DELETE /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 28 03:25:05.325247 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:05.325699 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:05.326485 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:05.326909 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:05.329701 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-85f96657-285f-4105-9f6d-544dc45b9e65 req-a175775a-c02b-4f15-a5fe-142a4c99e9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d20165-bd26-4933-9494-f57e12a4af62", "tag": "5ef0c0c3-3a01-4e07-9e58-af12fe750d01"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:25:05.339736 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-85f96657-285f-4105-9f6d-544dc45b9e65 req-a175775a-c02b-4f15-a5fe-142a4c99e9d0 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:05.340233 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-85f96657-285f-4105-9f6d-544dc45b9e65 req-a175775a-c02b-4f15-a5fe-142a4c99e9d0 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:05.348054 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Getting quotas for project cc2d6ae6d1f74852b9b51d970d19d0df. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:25:05.352967 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Getting quotas for user 3480ec26f30343e58a5e7b5329cb2cce and project cc2d6ae6d1f74852b9b51d970d19d0df. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:25:05.354021 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-85f96657-285f-4105-9f6d-544dc45b9e65 req-a175775a-c02b-4f15-a5fe-142a4c99e9d0 service nova] Creating event network-changed:5ef0c0c3-3a01-4e07-9e58-af12fe750d01 for instance 18d20165-bd26-4933-9494-f57e12a4af62 on hv-cinder-84684 Jun 28 03:25:05.359033 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-85f96657-285f-4105-9f6d-544dc45b9e65 req-a175775a-c02b-4f15-a5fe-142a4c99e9d0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033703 Jun 28 03:25:05.359813 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 394/787] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:25:05.367481 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6a30652b-67bb-4582-840a-4af324cd5968 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:05.368260 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6a30652b-67bb-4582-840a-4af324cd5968 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:05.376406 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6a30652b-67bb-4582-840a-4af324cd5968 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:05.376845 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6a30652b-67bb-4582-840a-4af324cd5968 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:05.377603 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6a30652b-67bb-4582-840a-4af324cd5968 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:05.378024 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6a30652b-67bb-4582-840a-4af324cd5968 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:05.422505 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Going to run 1 instances... {{(pid=117681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:25:05.424878 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d135ac5b-1d3d-4232-8066-7666c8fec78b',volume_size=None,volume_type=None)] {{(pid=117681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:25:05.538388 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6a30652b-67bb-4582-840a-4af324cd5968 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:05.547429 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6a30652b-67bb-4582-840a-4af324cd5968 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.183800 Jun 28 03:25:05.548326 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 395/788] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:05 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:05.589072 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-8c4d13e4-247c-4a51-a966-810bdb0fb09f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.425628 Jun 28 03:25:05.590151 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 394/789] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:25:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:25:05.600463 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-59a07e00-0b2e-4b7e-8ad0-ea37ae248f92 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:05.601072 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-59a07e00-0b2e-4b7e-8ad0-ea37ae248f92 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:05.655008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-59a07e00-0b2e-4b7e-8ad0-ea37ae248f92 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:05.662758 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-59a07e00-0b2e-4b7e-8ad0-ea37ae248f92 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1095 microversion: 2.1 time: 0.066077 Jun 28 03:25:05.663536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 396/790] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:05 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:25:06.568309 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-13e37fe7-f39f-4841-998a-cd5af44588db tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:06.569074 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-13e37fe7-f39f-4841-998a-cd5af44588db tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:06.576724 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-13e37fe7-f39f-4841-998a-cd5af44588db tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:06.577156 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-13e37fe7-f39f-4841-998a-cd5af44588db tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:06.577923 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-13e37fe7-f39f-4841-998a-cd5af44588db tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:06.578350 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-13e37fe7-f39f-4841-998a-cd5af44588db tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:06.679910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-67652fa7-72e3-4b67-8056-7c7025cd1a25 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:06.680590 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-67652fa7-72e3-4b67-8056-7c7025cd1a25 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:06.688497 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-67652fa7-72e3-4b67-8056-7c7025cd1a25 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:06.689287 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-67652fa7-72e3-4b67-8056-7c7025cd1a25 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:06.690341 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-67652fa7-72e3-4b67-8056-7c7025cd1a25 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:06.690846 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-67652fa7-72e3-4b67-8056-7c7025cd1a25 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:06.771993 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-67652fa7-72e3-4b67-8056-7c7025cd1a25 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:06.777156 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-13e37fe7-f39f-4841-998a-cd5af44588db tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:06.780346 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-67652fa7-72e3-4b67-8056-7c7025cd1a25 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1145 microversion: 2.1 time: 0.104105 Jun 28 03:25:06.783846 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 397/791] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:06 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1145 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:06.790798 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-13e37fe7-f39f-4841-998a-cd5af44588db tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.227417 Jun 28 03:25:06.791624 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 395/792] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:06 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:07.797986 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-32419052-d22b-4b9a-8941-14033989f617 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:07.799460 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-32419052-d22b-4b9a-8941-14033989f617 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:07.808327 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-444c8d31-ab3b-4830-bae2-68ff20fdcf09 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:07.809588 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-444c8d31-ab3b-4830-bae2-68ff20fdcf09 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:07.819109 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-444c8d31-ab3b-4830-bae2-68ff20fdcf09 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:07.819551 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-444c8d31-ab3b-4830-bae2-68ff20fdcf09 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:07.822022 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-32419052-d22b-4b9a-8941-14033989f617 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:07.822423 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-32419052-d22b-4b9a-8941-14033989f617 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:07.823303 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-32419052-d22b-4b9a-8941-14033989f617 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:07.823612 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-32419052-d22b-4b9a-8941-14033989f617 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:07.824818 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-444c8d31-ab3b-4830-bae2-68ff20fdcf09 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:07.825281 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-444c8d31-ab3b-4830-bae2-68ff20fdcf09 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:07.916506 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-32419052-d22b-4b9a-8941-14033989f617 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:07.930007 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-32419052-d22b-4b9a-8941-14033989f617 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1211 microversion: 2.1 time: 0.136608 Jun 28 03:25:07.938198 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 398/793] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:07 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1211 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:08.016469 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-444c8d31-ab3b-4830-bae2-68ff20fdcf09 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:08.024037 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-444c8d31-ab3b-4830-bae2-68ff20fdcf09 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1568 microversion: 2.1 time: 0.219623 Jun 28 03:25:08.025295 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 396/794] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:07 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:08.121371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-a3349261-9687-42bb-9339-8ec0661e62af req-a00dc51e-60db-4c95-a2b6-8693d75557d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d20165-bd26-4933-9494-f57e12a4af62", "name": "network-vif-deleted", "tag": "5ef0c0c3-3a01-4e07-9e58-af12fe750d01"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:25:08.132630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a3349261-9687-42bb-9339-8ec0661e62af req-a00dc51e-60db-4c95-a2b6-8693d75557d1 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:08.133600 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a3349261-9687-42bb-9339-8ec0661e62af req-a00dc51e-60db-4c95-a2b6-8693d75557d1 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:08.146534 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-a3349261-9687-42bb-9339-8ec0661e62af req-a00dc51e-60db-4c95-a2b6-8693d75557d1 service nova] Creating event network-vif-deleted:5ef0c0c3-3a01-4e07-9e58-af12fe750d01 for instance 18d20165-bd26-4933-9494-f57e12a4af62 on hv-cinder-84684 Jun 28 03:25:08.152000 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-a3349261-9687-42bb-9339-8ec0661e62af req-a00dc51e-60db-4c95-a2b6-8693d75557d1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034570 Jun 28 03:25:08.152775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 399/795] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:25:08.954989 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f613702a-a7fe-487b-9104-e6f88f4a8051 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:08.955657 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f613702a-a7fe-487b-9104-e6f88f4a8051 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:08.962701 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f613702a-a7fe-487b-9104-e6f88f4a8051 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:08.963221 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f613702a-a7fe-487b-9104-e6f88f4a8051 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:08.964042 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f613702a-a7fe-487b-9104-e6f88f4a8051 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:08.964491 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f613702a-a7fe-487b-9104-e6f88f4a8051 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:09.042682 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5939f0b9-8aec-4a82-8b0f-4c31db336b82 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:09.044001 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5939f0b9-8aec-4a82-8b0f-4c31db336b82 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:09.051408 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5939f0b9-8aec-4a82-8b0f-4c31db336b82 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:09.051864 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5939f0b9-8aec-4a82-8b0f-4c31db336b82 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:09.052664 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5939f0b9-8aec-4a82-8b0f-4c31db336b82 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:09.053092 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5939f0b9-8aec-4a82-8b0f-4c31db336b82 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:09.091680 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5939f0b9-8aec-4a82-8b0f-4c31db336b82 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:09.092089 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5939f0b9-8aec-4a82-8b0f-4c31db336b82 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:09.092589 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-5939f0b9-8aec-4a82-8b0f-4c31db336b82 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lazy-loading 'fault' on Instance uuid 18d20165-bd26-4933-9494-f57e12a4af62 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:25:09.146507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-f613702a-a7fe-487b-9104-e6f88f4a8051 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:09.151428 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5939f0b9-8aec-4a82-8b0f-4c31db336b82 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c20be92bb6664d518ad0550c43b5e378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcfe66d2ca71404e9b032806db987d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:09.155449 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f613702a-a7fe-487b-9104-e6f88f4a8051 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.204507 Jun 28 03:25:09.156024 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 397/796] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:08 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:09.159600 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5939f0b9-8aec-4a82-8b0f-4c31db336b82 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 200 len: 1224 microversion: 2.1 time: 0.121562 Jun 28 03:25:09.160286 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 400/797] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:09 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 1224 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:25:10.176271 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-15d4ee37-a2d1-4d1f-a3a8-fad20a974dcc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:10.176826 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-64bb51b2-38fe-4562-aef7-c529302b2619 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:10.177166 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-15d4ee37-a2d1-4d1f-a3a8-fad20a974dcc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:10.177290 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-64bb51b2-38fe-4562-aef7-c529302b2619 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] [instance: 18d20165-bd26-4933-9494-f57e12a4af62] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:10.183484 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-64bb51b2-38fe-4562-aef7-c529302b2619 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:10.184194 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-64bb51b2-38fe-4562-aef7-c529302b2619 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:10.184722 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-15d4ee37-a2d1-4d1f-a3a8-fad20a974dcc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:10.185086 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-64bb51b2-38fe-4562-aef7-c529302b2619 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:10.185290 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-15d4ee37-a2d1-4d1f-a3a8-fad20a974dcc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:10.185752 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-64bb51b2-38fe-4562-aef7-c529302b2619 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:10.189596 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-15d4ee37-a2d1-4d1f-a3a8-fad20a974dcc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:10.190134 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-15d4ee37-a2d1-4d1f-a3a8-fad20a974dcc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:10.200506 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-64bb51b2-38fe-4562-aef7-c529302b2619 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] HTTP exception thrown: Instance 18d20165-bd26-4933-9494-f57e12a4af62 could not be found. Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-64bb51b2-38fe-4562-aef7-c529302b2619 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Request method failure captured: Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 HTTP/1.1 Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunM9Lra76cKH6EcvENIhUmZvRR2njOQiLcUzebRcxGYXbCxp4oZ0WjxNSF1rvIfvLrDct8iv7q6ISFOAHBT5O4TvyheKM6OEenRd8N3DI6Ztfxk9O0dTX_VE015eunFyNLLrROXqQerKZ-XdSPwKFxiik7xS2z7NHKa2kwT-5edNH-c Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: bcfe66d2ca71404e9b032806db987d4d Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-TestShelveInstance-792593003 Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:25:10.202207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:25:10.203912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bcfe66d2ca71404e9b032806db987d4d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bcfe66d2ca71404e9b032806db987d4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcfe66d2ca71404e9b032806db987d4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bcfe66d2ca71404e9b032806db987d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:25:10.203912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-TestShelveInstance-792593003 Jun 28 03:25:10.203912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: bcfe66d2ca71404e9b032806db987d4d Jun 28 03:25:10.203912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-TestShelveInstance-792593003 Jun 28 03:25:10.203912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-TestShelveInstance-792593003-project Jun 28 03:25:10.203912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:25:10.203912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:25:10.203912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: c20be92bb6664d518ad0550c43b5e378 Jun 28 03:25:10.203912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-TestShelveInstance-792593003-project Jun 28 03:25:10.203912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:25:10.203912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 18d20165-bd26-4933-9494-f57e12a4af62 could not be found. Jun 28 03:25:10.203912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '18d20165-bd26-4933-9494-f57e12a4af62'} Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d20165-bd26-4933-9494-f57e12a4af62 could not be found. Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:25:10.204839 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d20165-bd26-4933-9494-f57e12a4af62 could not be found. Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d20165-bd26-4933-9494-f57e12a4af62 could not be found. Jun 28 03:25:10.207768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:25:10.211795 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-64bb51b2-38fe-4562-aef7-c529302b2619 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Returning 404 to user: Instance 18d20165-bd26-4933-9494-f57e12a4af62 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:25:10.211795 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-64bb51b2-38fe-4562-aef7-c529302b2619 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62" status: 404 len: 111 microversion: 2.1 time: 0.031103 Jun 28 03:25:10.211795 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 401/798] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:10 2022] GET /compute/v2.1/servers/18d20165-bd26-4933-9494-f57e12a4af62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 03:25:10.211795 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-d0f73f58-cc47-4b4a-bca0-51fc0cad8dd3 req-9d9a7f01-9a35-4309-baae-fd6875fc89cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e32105-0f00-4bec-be78-59f9383e3992", "tag": "8216d3f8-6222-4089-bdc6-74085387c8a5"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:25:10.221095 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-d0f73f58-cc47-4b4a-bca0-51fc0cad8dd3 req-9d9a7f01-9a35-4309-baae-fd6875fc89cc service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:10.221542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-d0f73f58-cc47-4b4a-bca0-51fc0cad8dd3 req-9d9a7f01-9a35-4309-baae-fd6875fc89cc service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:10.234543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-d0f73f58-cc47-4b4a-bca0-51fc0cad8dd3 req-9d9a7f01-9a35-4309-baae-fd6875fc89cc service nova] Creating event network-changed:8216d3f8-6222-4089-bdc6-74085387c8a5 for instance 10e32105-0f00-4bec-be78-59f9383e3992 on hv-cinder-84684 Jun 28 03:25:10.239255 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-d0f73f58-cc47-4b4a-bca0-51fc0cad8dd3 req-9d9a7f01-9a35-4309-baae-fd6875fc89cc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030964 Jun 28 03:25:10.239865 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 402/799] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:25:10.346199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-15d4ee37-a2d1-4d1f-a3a8-fad20a974dcc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:10.354404 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-15d4ee37-a2d1-4d1f-a3a8-fad20a974dcc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.185212 Jun 28 03:25:10.354967 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 398/800] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:10 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:10.397938 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a7bbbd7f-e882-4d1c-90fd-07753fbd1377 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] Calling method '.version_select at 0x7f53f1b7d670>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:10.416702 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a7bbbd7f-e882-4d1c-90fd-07753fbd1377 tempest-TestShelveInstance-792593003 tempest-TestShelveInstance-792593003-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-378644166" status: 202 len: 0 microversion: 2.1 time: 0.025009 Jun 28 03:25:10.417277 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 403/801] 10.222.0.44 () {58 vars in 1250 bytes} [Tue Jun 28 03:25:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-378644166 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:25:11.371977 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4d8da496-a60e-44c8-9ba5-49184b96629b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:11.373436 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4d8da496-a60e-44c8-9ba5-49184b96629b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:11.380122 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4d8da496-a60e-44c8-9ba5-49184b96629b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:11.380603 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4d8da496-a60e-44c8-9ba5-49184b96629b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:11.381364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4d8da496-a60e-44c8-9ba5-49184b96629b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:11.381799 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4d8da496-a60e-44c8-9ba5-49184b96629b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:11.531062 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4d8da496-a60e-44c8-9ba5-49184b96629b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:11.538613 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4d8da496-a60e-44c8-9ba5-49184b96629b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.170473 Jun 28 03:25:11.539557 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 399/802] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:11 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:12.556932 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-125a17f5-a322-4c4a-802f-ab8398c9d2c3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:12.557664 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-125a17f5-a322-4c4a-802f-ab8398c9d2c3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:12.564882 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-125a17f5-a322-4c4a-802f-ab8398c9d2c3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:12.565323 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-125a17f5-a322-4c4a-802f-ab8398c9d2c3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:12.566082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-125a17f5-a322-4c4a-802f-ab8398c9d2c3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:12.566537 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-125a17f5-a322-4c4a-802f-ab8398c9d2c3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:12.703380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-125a17f5-a322-4c4a-802f-ab8398c9d2c3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:12.711171 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-125a17f5-a322-4c4a-802f-ab8398c9d2c3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.158658 Jun 28 03:25:12.711742 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 404/803] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:12 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:13.728818 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7a4255a5-5be6-4acc-a6b2-6c14d301c7e1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:13.729438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7a4255a5-5be6-4acc-a6b2-6c14d301c7e1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:13.736584 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7a4255a5-5be6-4acc-a6b2-6c14d301c7e1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:13.737329 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7a4255a5-5be6-4acc-a6b2-6c14d301c7e1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:13.738306 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7a4255a5-5be6-4acc-a6b2-6c14d301c7e1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:13.738907 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7a4255a5-5be6-4acc-a6b2-6c14d301c7e1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:13.899260 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7a4255a5-5be6-4acc-a6b2-6c14d301c7e1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:13.907431 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7a4255a5-5be6-4acc-a6b2-6c14d301c7e1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.182872 Jun 28 03:25:13.908031 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 400/804] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:13 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:14.924523 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9fc04cc8-4a44-4fab-a112-0670f290bb05 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:14.925129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9fc04cc8-4a44-4fab-a112-0670f290bb05 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:14.933484 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9fc04cc8-4a44-4fab-a112-0670f290bb05 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:14.933997 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9fc04cc8-4a44-4fab-a112-0670f290bb05 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:14.935079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9fc04cc8-4a44-4fab-a112-0670f290bb05 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:14.935508 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9fc04cc8-4a44-4fab-a112-0670f290bb05 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:15.172110 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9fc04cc8-4a44-4fab-a112-0670f290bb05 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:15.180669 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9fc04cc8-4a44-4fab-a112-0670f290bb05 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.259962 Jun 28 03:25:15.191146 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 405/805] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:14 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:16.198049 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-96697030-7b8c-4094-87b3-1d2dfd38eccc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:16.199573 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-96697030-7b8c-4094-87b3-1d2dfd38eccc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:16.205370 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:16.206117 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=6 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:16.207923 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-96697030-7b8c-4094-87b3-1d2dfd38eccc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:16.208555 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-96697030-7b8c-4094-87b3-1d2dfd38eccc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:16.209599 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-96697030-7b8c-4094-87b3-1d2dfd38eccc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:16.210319 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-96697030-7b8c-4094-87b3-1d2dfd38eccc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:16.347367 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-96697030-7b8c-4094-87b3-1d2dfd38eccc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:16.355600 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-96697030-7b8c-4094-87b3-1d2dfd38eccc tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.161326 Jun 28 03:25:16.356195 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 401/806] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:16 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:17.372616 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4c86988f-67e7-4ce9-8a8b-c9791aaba87e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:17.373299 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4c86988f-67e7-4ce9-8a8b-c9791aaba87e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:17.375478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:17.382687 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4c86988f-67e7-4ce9-8a8b-c9791aaba87e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:17.383244 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4c86988f-67e7-4ce9-8a8b-c9791aaba87e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:17.384211 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4c86988f-67e7-4ce9-8a8b-c9791aaba87e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:17.388865 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4c86988f-67e7-4ce9-8a8b-c9791aaba87e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:17.532010 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4c86988f-67e7-4ce9-8a8b-c9791aaba87e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:17.543121 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4c86988f-67e7-4ce9-8a8b-c9791aaba87e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.174151 Jun 28 03:25:17.543933 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 406/807] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:17 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:18.563160 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6697734a-c70f-43f1-b83f-41aea631517d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:18.563739 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6697734a-c70f-43f1-b83f-41aea631517d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:18.570601 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6697734a-c70f-43f1-b83f-41aea631517d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:18.571065 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6697734a-c70f-43f1-b83f-41aea631517d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:18.571819 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6697734a-c70f-43f1-b83f-41aea631517d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:18.572283 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6697734a-c70f-43f1-b83f-41aea631517d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:18.714207 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6697734a-c70f-43f1-b83f-41aea631517d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:18.722275 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6697734a-c70f-43f1-b83f-41aea631517d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.163460 Jun 28 03:25:18.722839 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 402/808] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:18 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:19.745928 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f5035907-74c9-41cf-9cd0-d6723193aba3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:19.747460 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f5035907-74c9-41cf-9cd0-d6723193aba3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:19.759146 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f5035907-74c9-41cf-9cd0-d6723193aba3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:19.759885 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f5035907-74c9-41cf-9cd0-d6723193aba3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:19.761256 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f5035907-74c9-41cf-9cd0-d6723193aba3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:19.761972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f5035907-74c9-41cf-9cd0-d6723193aba3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:19.897893 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f5035907-74c9-41cf-9cd0-d6723193aba3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:19.906139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f5035907-74c9-41cf-9cd0-d6723193aba3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.169579 Jun 28 03:25:19.906684 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 407/809] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:19 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:20.932794 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8b0116cb-cb2a-4dc4-a195-b5c755cc880c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:20.933772 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-8b0116cb-cb2a-4dc4-a195-b5c755cc880c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:20.941638 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8b0116cb-cb2a-4dc4-a195-b5c755cc880c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:20.942080 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8b0116cb-cb2a-4dc4-a195-b5c755cc880c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:20.942841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8b0116cb-cb2a-4dc4-a195-b5c755cc880c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:20.943274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-8b0116cb-cb2a-4dc4-a195-b5c755cc880c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:21.084327 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-8b0116cb-cb2a-4dc4-a195-b5c755cc880c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:21.091857 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-8b0116cb-cb2a-4dc4-a195-b5c755cc880c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.165726 Jun 28 03:25:21.092890 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 403/810] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:20 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:22.112127 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1210ae0e-7777-4c01-9460-6a76974501f3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:22.112851 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1210ae0e-7777-4c01-9460-6a76974501f3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:22.122153 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1210ae0e-7777-4c01-9460-6a76974501f3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:22.122723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1210ae0e-7777-4c01-9460-6a76974501f3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:22.123788 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1210ae0e-7777-4c01-9460-6a76974501f3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:22.124415 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1210ae0e-7777-4c01-9460-6a76974501f3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:22.263264 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1210ae0e-7777-4c01-9460-6a76974501f3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:22.271337 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1210ae0e-7777-4c01-9460-6a76974501f3 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.164808 Jun 28 03:25:22.271901 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 408/811] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:22 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:23.292546 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e5a427dd-8a49-4948-bb0a-128a40f447a0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:23.293533 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e5a427dd-8a49-4948-bb0a-128a40f447a0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:23.304838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e5a427dd-8a49-4948-bb0a-128a40f447a0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:23.305577 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e5a427dd-8a49-4948-bb0a-128a40f447a0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:23.306827 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e5a427dd-8a49-4948-bb0a-128a40f447a0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:23.307541 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e5a427dd-8a49-4948-bb0a-128a40f447a0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:23.457939 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e5a427dd-8a49-4948-bb0a-128a40f447a0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:23.474573 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e5a427dd-8a49-4948-bb0a-128a40f447a0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.188534 Jun 28 03:25:23.475166 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 404/812] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:23 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:24.498514 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-feada907-4d0d-4060-a9f7-db6d5458e3ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:24.499513 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-feada907-4d0d-4060-a9f7-db6d5458e3ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:24.510590 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-feada907-4d0d-4060-a9f7-db6d5458e3ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:24.511360 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-feada907-4d0d-4060-a9f7-db6d5458e3ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:24.512757 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-feada907-4d0d-4060-a9f7-db6d5458e3ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:24.513602 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-feada907-4d0d-4060-a9f7-db6d5458e3ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:24.649910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-feada907-4d0d-4060-a9f7-db6d5458e3ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:24.657707 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-feada907-4d0d-4060-a9f7-db6d5458e3ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.165832 Jun 28 03:25:24.658236 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 409/813] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:24 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:25.677146 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e1c0ceb2-3a20-45c6-a26f-877b99cfd18c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:25.677737 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e1c0ceb2-3a20-45c6-a26f-877b99cfd18c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:25.685710 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e1c0ceb2-3a20-45c6-a26f-877b99cfd18c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:25.686177 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e1c0ceb2-3a20-45c6-a26f-877b99cfd18c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:25.686979 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e1c0ceb2-3a20-45c6-a26f-877b99cfd18c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:25.687428 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e1c0ceb2-3a20-45c6-a26f-877b99cfd18c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:25.827119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e1c0ceb2-3a20-45c6-a26f-877b99cfd18c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:25.835327 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e1c0ceb2-3a20-45c6-a26f-877b99cfd18c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.162873 Jun 28 03:25:25.835890 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 405/814] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:25 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:26.853170 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-77ad37bc-a586-445e-9479-8e090c6f7a7c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:26.853767 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-77ad37bc-a586-445e-9479-8e090c6f7a7c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:26.860580 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77ad37bc-a586-445e-9479-8e090c6f7a7c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:26.860980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77ad37bc-a586-445e-9479-8e090c6f7a7c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:26.861731 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77ad37bc-a586-445e-9479-8e090c6f7a7c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:26.862318 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77ad37bc-a586-445e-9479-8e090c6f7a7c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:27.002096 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-77ad37bc-a586-445e-9479-8e090c6f7a7c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:27.010184 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-77ad37bc-a586-445e-9479-8e090c6f7a7c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.161569 Jun 28 03:25:27.010750 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 410/815] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:26 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:28.027583 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-69c9b9f5-b816-49a4-83e2-be443f175c19 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:28.029000 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-69c9b9f5-b816-49a4-83e2-be443f175c19 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:28.035676 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-69c9b9f5-b816-49a4-83e2-be443f175c19 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:28.036306 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-69c9b9f5-b816-49a4-83e2-be443f175c19 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:28.037111 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-69c9b9f5-b816-49a4-83e2-be443f175c19 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:28.037759 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-69c9b9f5-b816-49a4-83e2-be443f175c19 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:28.168565 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-69c9b9f5-b816-49a4-83e2-be443f175c19 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:28.176522 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-69c9b9f5-b816-49a4-83e2-be443f175c19 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.153171 Jun 28 03:25:28.177100 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 406/816] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:28 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:29.102129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e38aebf8-8809-437b-ae24-ca488d329c3e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:29.102699 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e38aebf8-8809-437b-ae24-ca488d329c3e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:29.114532 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e38aebf8-8809-437b-ae24-ca488d329c3e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:29.115020 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e38aebf8-8809-437b-ae24-ca488d329c3e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:29.115940 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e38aebf8-8809-437b-ae24-ca488d329c3e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:29.116395 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e38aebf8-8809-437b-ae24-ca488d329c3e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:29.141116 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e38aebf8-8809-437b-ae24-ca488d329c3e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/ips" status: 200 len: 146 microversion: 2.1 time: 0.043316 Jun 28 03:25:29.141921 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 411/817] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 28 03:25:29 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:25:29.194089 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7c83c3ef-1f06-4303-85c4-13af243ff0ed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:29.194685 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7c83c3ef-1f06-4303-85c4-13af243ff0ed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:29.201642 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7c83c3ef-1f06-4303-85c4-13af243ff0ed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:29.202169 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7c83c3ef-1f06-4303-85c4-13af243ff0ed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:29.202951 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7c83c3ef-1f06-4303-85c4-13af243ff0ed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:29.203354 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7c83c3ef-1f06-4303-85c4-13af243ff0ed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:29.354408 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7c83c3ef-1f06-4303-85c4-13af243ff0ed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:29.364039 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7c83c3ef-1f06-4303-85c4-13af243ff0ed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.173533 Jun 28 03:25:29.365095 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 407/818] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:29 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:30.382181 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d1d3a37d-8224-420b-b3e7-67b05254cdb8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:30.382993 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d1d3a37d-8224-420b-b3e7-67b05254cdb8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:30.390280 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d1d3a37d-8224-420b-b3e7-67b05254cdb8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:30.390727 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d1d3a37d-8224-420b-b3e7-67b05254cdb8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:30.391483 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d1d3a37d-8224-420b-b3e7-67b05254cdb8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:30.392089 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d1d3a37d-8224-420b-b3e7-67b05254cdb8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:30.435969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:30.605011 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d1d3a37d-8224-420b-b3e7-67b05254cdb8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:30.615826 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d1d3a37d-8224-420b-b3e7-67b05254cdb8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.236544 Jun 28 03:25:30.617179 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 412/819] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:30 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:31.411487 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2eb227b1-b140-4c92-a73e-a02d7cc8d1de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc2f4883-f227-453b-a61f-b81c24d5a834"}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:25:31.412783 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2eb227b1-b140-4c92-a73e-a02d7cc8d1de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:31.419486 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2eb227b1-b140-4c92-a73e-a02d7cc8d1de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:31.419931 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2eb227b1-b140-4c92-a73e-a02d7cc8d1de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:31.420730 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2eb227b1-b140-4c92-a73e-a02d7cc8d1de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:31.421162 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2eb227b1-b140-4c92-a73e-a02d7cc8d1de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:31.633049 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-87b3102a-cad5-43ff-a1ca-23e35313b498 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:31.635126 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-87b3102a-cad5-43ff-a1ca-23e35313b498 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:31.644621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-87b3102a-cad5-43ff-a1ca-23e35313b498 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:31.645074 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-87b3102a-cad5-43ff-a1ca-23e35313b498 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:31.645854 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-87b3102a-cad5-43ff-a1ca-23e35313b498 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:31.646290 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-87b3102a-cad5-43ff-a1ca-23e35313b498 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:31.786792 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2eb227b1-b140-4c92-a73e-a02d7cc8d1de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "POST /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380463 Jun 28 03:25:31.788098 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 408/820] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:25:31 2022] POST /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:25:31.826387 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-87b3102a-cad5-43ff-a1ca-23e35313b498 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:31.836328 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-87b3102a-cad5-43ff-a1ca-23e35313b498 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.206543 Jun 28 03:25:31.836505 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 413/821] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:31 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:32.857821 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ce5b807d-d697-4bbd-bd18-2e923c9f3f7e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:32.858542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ce5b807d-d697-4bbd-bd18-2e923c9f3f7e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:32.866039 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ce5b807d-d697-4bbd-bd18-2e923c9f3f7e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:32.866395 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ce5b807d-d697-4bbd-bd18-2e923c9f3f7e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:32.867161 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ce5b807d-d697-4bbd-bd18-2e923c9f3f7e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:32.867589 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ce5b807d-d697-4bbd-bd18-2e923c9f3f7e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:33.089851 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ce5b807d-d697-4bbd-bd18-2e923c9f3f7e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:33.095722 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:33.102941 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ce5b807d-d697-4bbd-bd18-2e923c9f3f7e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.250439 Jun 28 03:25:33.112923 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 409/822] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:32 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:34.122844 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9950d283-271f-4edc-93e2-f1a397046de9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:34.123475 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9950d283-271f-4edc-93e2-f1a397046de9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:34.131885 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9950d283-271f-4edc-93e2-f1a397046de9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:34.133321 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9950d283-271f-4edc-93e2-f1a397046de9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:34.134360 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9950d283-271f-4edc-93e2-f1a397046de9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:34.134945 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9950d283-271f-4edc-93e2-f1a397046de9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:34.353566 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9950d283-271f-4edc-93e2-f1a397046de9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:34.368630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9950d283-271f-4edc-93e2-f1a397046de9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.251626 Jun 28 03:25:34.371093 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 414/823] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:34 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:35.388249 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2e5b59fb-b3df-4f59-bad5-6f6173879e8a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:35.389251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2e5b59fb-b3df-4f59-bad5-6f6173879e8a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:35.391178 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:35.413195 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2e5b59fb-b3df-4f59-bad5-6f6173879e8a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:35.413653 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2e5b59fb-b3df-4f59-bad5-6f6173879e8a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:35.414441 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2e5b59fb-b3df-4f59-bad5-6f6173879e8a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:35.420621 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2e5b59fb-b3df-4f59-bad5-6f6173879e8a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:35.596387 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2e5b59fb-b3df-4f59-bad5-6f6173879e8a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:35.606877 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2e5b59fb-b3df-4f59-bad5-6f6173879e8a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.223830 Jun 28 03:25:35.617771 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 410/824] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:35 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:36.625472 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ee20205c-48b6-4f07-a892-9a83c93597df tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:36.626008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ee20205c-48b6-4f07-a892-9a83c93597df tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:36.628726 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:36.635716 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ee20205c-48b6-4f07-a892-9a83c93597df tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:36.636542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ee20205c-48b6-4f07-a892-9a83c93597df tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:36.637351 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ee20205c-48b6-4f07-a892-9a83c93597df tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:36.637966 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ee20205c-48b6-4f07-a892-9a83c93597df tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:36.820067 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ee20205c-48b6-4f07-a892-9a83c93597df tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:36.833984 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ee20205c-48b6-4f07-a892-9a83c93597df tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.213249 Jun 28 03:25:36.835807 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 415/825] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:36 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:37.191232 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-c6ecc811-f45f-46bc-b38d-90621c7a2669 req-d2631bf6-251d-4d76-9ab5-b6b6fbd58ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e32105-0f00-4bec-be78-59f9383e3992", "name": "network-vif-plugged", "status": "completed", "tag": "8216d3f8-6222-4089-bdc6-74085387c8a5"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:25:37.200570 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-c6ecc811-f45f-46bc-b38d-90621c7a2669 req-d2631bf6-251d-4d76-9ab5-b6b6fbd58ad8 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:37.201011 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-c6ecc811-f45f-46bc-b38d-90621c7a2669 req-d2631bf6-251d-4d76-9ab5-b6b6fbd58ad8 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:37.228677 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-c6ecc811-f45f-46bc-b38d-90621c7a2669 req-d2631bf6-251d-4d76-9ab5-b6b6fbd58ad8 service nova] Creating event network-vif-plugged:8216d3f8-6222-4089-bdc6-74085387c8a5 for instance 10e32105-0f00-4bec-be78-59f9383e3992 on hv-cinder-84684 Jun 28 03:25:37.236359 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-c6ecc811-f45f-46bc-b38d-90621c7a2669 req-d2631bf6-251d-4d76-9ab5-b6b6fbd58ad8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047805 Jun 28 03:25:37.237783 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 411/826] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:25:37.851358 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f7d7cfec-4b9f-43bb-a693-92233a06b38e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:37.851987 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f7d7cfec-4b9f-43bb-a693-92233a06b38e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:37.862961 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7d7cfec-4b9f-43bb-a693-92233a06b38e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:37.863918 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7d7cfec-4b9f-43bb-a693-92233a06b38e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:37.864124 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7d7cfec-4b9f-43bb-a693-92233a06b38e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:37.864621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7d7cfec-4b9f-43bb-a693-92233a06b38e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:38.045886 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f7d7cfec-4b9f-43bb-a693-92233a06b38e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:38.056945 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f7d7cfec-4b9f-43bb-a693-92233a06b38e tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1267 microversion: 2.1 time: 0.209844 Jun 28 03:25:38.058048 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 416/827] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:37 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:39.080521 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-813af9d2-f7ea-4cd3-a49a-8df5c42efaf0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:39.082050 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-813af9d2-f7ea-4cd3-a49a-8df5c42efaf0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:39.092524 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-813af9d2-f7ea-4cd3-a49a-8df5c42efaf0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:39.093593 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-813af9d2-f7ea-4cd3-a49a-8df5c42efaf0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:39.095281 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-813af9d2-f7ea-4cd3-a49a-8df5c42efaf0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:39.096293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-813af9d2-f7ea-4cd3-a49a-8df5c42efaf0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:39.327537 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-813af9d2-f7ea-4cd3-a49a-8df5c42efaf0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:39.338695 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-813af9d2-f7ea-4cd3-a49a-8df5c42efaf0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1454 microversion: 2.1 time: 0.265250 Jun 28 03:25:39.339448 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 412/828] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:39 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1454 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:39.355627 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-59202a84-e7fb-4c37-a4b2-270e07165c34 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:39.356894 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-59202a84-e7fb-4c37-a4b2-270e07165c34 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:39.364622 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-59202a84-e7fb-4c37-a4b2-270e07165c34 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:39.365316 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-59202a84-e7fb-4c37-a4b2-270e07165c34 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:39.366930 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-59202a84-e7fb-4c37-a4b2-270e07165c34 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:39.367523 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-59202a84-e7fb-4c37-a4b2-270e07165c34 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:39.536230 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ea6bdb86-a587-45e8-a635-c8ba183a6467 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:25:39.542565 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea6bdb86-a587-45e8-a635-c8ba183a6467 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:39.543215 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea6bdb86-a587-45e8-a635-c8ba183a6467 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:39.590213 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-59202a84-e7fb-4c37-a4b2-270e07165c34 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:39.602892 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-59202a84-e7fb-4c37-a4b2-270e07165c34 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1454 microversion: 2.1 time: 0.251001 Jun 28 03:25:39.622268 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 417/829] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:39 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1454 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:39.667160 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ea6bdb86-a587-45e8-a635-c8ba183a6467 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Going to try to stop instance {{(pid=117681) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 28 03:25:39.763974 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ea6bdb86-a587-45e8-a635-c8ba183a6467 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "POST /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/action" status: 202 len: 0 microversion: 2.1 time: 0.231494 Jun 28 03:25:39.766168 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 413/830] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:25:39 2022] POST /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 03:25:39.773822 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-51533e04-dbd8-4262-a3ce-953b8f55e818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:39.774905 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-51533e04-dbd8-4262-a3ce-953b8f55e818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:39.785436 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51533e04-dbd8-4262-a3ce-953b8f55e818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:39.786644 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51533e04-dbd8-4262-a3ce-953b8f55e818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:39.792922 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51533e04-dbd8-4262-a3ce-953b8f55e818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:39.793538 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-51533e04-dbd8-4262-a3ce-953b8f55e818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:40.011651 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-51533e04-dbd8-4262-a3ce-953b8f55e818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:40.021669 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-51533e04-dbd8-4262-a3ce-953b8f55e818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.251544 Jun 28 03:25:40.033758 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 418/831] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:39 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:41.042305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-58b598e2-da73-4a7c-8868-7681829cbd21 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:41.043663 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-58b598e2-da73-4a7c-8868-7681829cbd21 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:41.054313 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-58b598e2-da73-4a7c-8868-7681829cbd21 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:41.055050 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-58b598e2-da73-4a7c-8868-7681829cbd21 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:41.055984 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-58b598e2-da73-4a7c-8868-7681829cbd21 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:41.056609 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-58b598e2-da73-4a7c-8868-7681829cbd21 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:41.261165 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-58b598e2-da73-4a7c-8868-7681829cbd21 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:41.275336 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-58b598e2-da73-4a7c-8868-7681829cbd21 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.239212 Jun 28 03:25:41.288060 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 414/832] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:41 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:42.126836 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-68d136b2-fe36-4831-89a6-8de03c230a94 req-acf31c66-d866-4d6e-aabc-aba884c41b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e32105-0f00-4bec-be78-59f9383e3992", "tag": "8216d3f8-6222-4089-bdc6-74085387c8a5"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:25:42.138001 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-68d136b2-fe36-4831-89a6-8de03c230a94 req-acf31c66-d866-4d6e-aabc-aba884c41b5a service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:42.138968 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-68d136b2-fe36-4831-89a6-8de03c230a94 req-acf31c66-d866-4d6e-aabc-aba884c41b5a service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:42.155426 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-68d136b2-fe36-4831-89a6-8de03c230a94 req-acf31c66-d866-4d6e-aabc-aba884c41b5a service nova] Creating event network-changed:8216d3f8-6222-4089-bdc6-74085387c8a5 for instance 10e32105-0f00-4bec-be78-59f9383e3992 on hv-cinder-84684 Jun 28 03:25:42.162250 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-68d136b2-fe36-4831-89a6-8de03c230a94 req-acf31c66-d866-4d6e-aabc-aba884c41b5a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039239 Jun 28 03:25:42.163682 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 419/833] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:25:42.295887 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2aa714b7-2be0-4599-86e5-b4b104417fca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:42.297035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2aa714b7-2be0-4599-86e5-b4b104417fca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:42.314516 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2aa714b7-2be0-4599-86e5-b4b104417fca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:42.315291 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2aa714b7-2be0-4599-86e5-b4b104417fca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:42.316112 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2aa714b7-2be0-4599-86e5-b4b104417fca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:42.323957 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2aa714b7-2be0-4599-86e5-b4b104417fca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:42.569358 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2aa714b7-2be0-4599-86e5-b4b104417fca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:42.581970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2aa714b7-2be0-4599-86e5-b4b104417fca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.291977 Jun 28 03:25:42.593224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 415/834] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:42 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:43.601310 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-08e31127-4bf8-4a82-b29a-4e9bbc23f334 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:43.602157 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-08e31127-4bf8-4a82-b29a-4e9bbc23f334 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:43.622129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-08e31127-4bf8-4a82-b29a-4e9bbc23f334 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:43.625883 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-08e31127-4bf8-4a82-b29a-4e9bbc23f334 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:43.630291 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-08e31127-4bf8-4a82-b29a-4e9bbc23f334 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:43.632255 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-08e31127-4bf8-4a82-b29a-4e9bbc23f334 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:43.857862 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-08e31127-4bf8-4a82-b29a-4e9bbc23f334 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:43.868669 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-08e31127-4bf8-4a82-b29a-4e9bbc23f334 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.272851 Jun 28 03:25:43.880848 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 420/835] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:43 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:44.886877 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-42d0c972-ed6d-49fa-8864-b36f1c6c4e9a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:44.887466 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-42d0c972-ed6d-49fa-8864-b36f1c6c4e9a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:44.895025 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-42d0c972-ed6d-49fa-8864-b36f1c6c4e9a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:44.895708 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-42d0c972-ed6d-49fa-8864-b36f1c6c4e9a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:44.896689 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-42d0c972-ed6d-49fa-8864-b36f1c6c4e9a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:44.897274 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-42d0c972-ed6d-49fa-8864-b36f1c6c4e9a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:45.042619 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-42d0c972-ed6d-49fa-8864-b36f1c6c4e9a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:45.052720 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-42d0c972-ed6d-49fa-8864-b36f1c6c4e9a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.169647 Jun 28 03:25:45.053548 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 416/836] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:44 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:46.070487 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f7476d31-c303-4789-abc6-4e61e2ea18b0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:46.071761 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f7476d31-c303-4789-abc6-4e61e2ea18b0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:46.079817 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7476d31-c303-4789-abc6-4e61e2ea18b0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:46.080425 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7476d31-c303-4789-abc6-4e61e2ea18b0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:46.081600 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7476d31-c303-4789-abc6-4e61e2ea18b0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:46.082098 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7476d31-c303-4789-abc6-4e61e2ea18b0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:46.225006 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f7476d31-c303-4789-abc6-4e61e2ea18b0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:46.234134 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f7476d31-c303-4789-abc6-4e61e2ea18b0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.167660 Jun 28 03:25:46.235292 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 421/837] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:46 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:47.251504 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b38fada9-85b8-4d71-8eeb-e294cdaa3dc7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:47.252062 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b38fada9-85b8-4d71-8eeb-e294cdaa3dc7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:47.263104 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b38fada9-85b8-4d71-8eeb-e294cdaa3dc7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:47.263886 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b38fada9-85b8-4d71-8eeb-e294cdaa3dc7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:47.264812 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b38fada9-85b8-4d71-8eeb-e294cdaa3dc7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:47.265328 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b38fada9-85b8-4d71-8eeb-e294cdaa3dc7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:47.398828 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-226f5b1d-96bb-4ad5-9df6-1461adbec9e2 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Action: 'create', calling method: .version_select at 0x7f53f1adfa60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-710416305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJYFY5WpNVbfulFHHYfF+8uuBX0CmeRQAh7a9QPBuLFh7SR3QMloWex4vPOsGtDs4AA5Vkry2pB8XB1im19/jJ7F/dmRV7UKhgJvAM+fKGRhi/kQgahNUrU3WAXL5ZoTg=="}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:25:47.403968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b38fada9-85b8-4d71-8eeb-e294cdaa3dc7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:47.412307 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b38fada9-85b8-4d71-8eeb-e294cdaa3dc7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.164939 Jun 28 03:25:47.413012 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 417/838] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:47 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:47.413859 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-226f5b1d-96bb-4ad5-9df6-1461adbec9e2 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Getting quotas for project 75fde21fa6204de6976409a0d1c4c754. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:25:47.417827 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-226f5b1d-96bb-4ad5-9df6-1461adbec9e2 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Getting quotas for user f85e7ea701184ef5951da92ecb4cb9ee and project 75fde21fa6204de6976409a0d1c4c754. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:25:47.441027 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-226f5b1d-96bb-4ad5-9df6-1461adbec9e2 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045875 Jun 28 03:25:47.441620 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 422/839] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 28 03:25:47 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:25:47.491889 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-55024479", "imageRef": "52716574-458a-47a2-9dda-b4579c8e3540", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-710416305", "networks": [{"uuid": "9d824ab9-06a6-42d8-9d13-9eae7b9bd496"}]}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:25:47.542912 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.network.neutron [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] validate_networks() for [('9d824ab9-06a6-42d8-9d13-9eae7b9bd496', None, None, None, None, None)] {{(pid=117681) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:25:48.214948 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Flavor limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:25:48.215364 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Image limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:25:48.215829 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Flavor pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:25:48.216291 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Image pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:25:48.216717 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:25:48.227238 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:48.227677 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:48.228490 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:48.228913 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:48.409541 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Getting quotas for project 75fde21fa6204de6976409a0d1c4c754. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:25:48.417117 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Getting quotas for user f85e7ea701184ef5951da92ecb4cb9ee and project 75fde21fa6204de6976409a0d1c4c754. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:25:48.429641 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b4bd29d2-b44c-430f-9c49-ab282cf1e637 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:48.430825 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b4bd29d2-b44c-430f-9c49-ab282cf1e637 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:48.432107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Going to run 1 instances... {{(pid=117681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:25:48.434330 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='52716574-458a-47a2-9dda-b4579c8e3540',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:25:48.437444 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b4bd29d2-b44c-430f-9c49-ab282cf1e637 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:48.437888 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b4bd29d2-b44c-430f-9c49-ab282cf1e637 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:48.438654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b4bd29d2-b44c-430f-9c49-ab282cf1e637 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:48.439079 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b4bd29d2-b44c-430f-9c49-ab282cf1e637 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:48.481194 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-35bfec10-12e6-447e-86c9-313cee57c587 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993085 Jun 28 03:25:48.481953 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 418/840] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:25:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:25:48.492314 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-75c39ec7-b3cf-49f1-9b5f-85482bb5ee38 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:48.492915 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-75c39ec7-b3cf-49f1-9b5f-85482bb5ee38 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:48.564917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-75c39ec7-b3cf-49f1-9b5f-85482bb5ee38 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:48.572052 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-75c39ec7-b3cf-49f1-9b5f-85482bb5ee38 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1256 microversion: 2.1 time: 0.083725 Jun 28 03:25:48.572662 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 419/841] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:48 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1256 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:48.596821 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b4bd29d2-b44c-430f-9c49-ab282cf1e637 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:48.605530 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b4bd29d2-b44c-430f-9c49-ab282cf1e637 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.180393 Jun 28 03:25:48.606107 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 423/842] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:48 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:25:49.589183 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-da81108f-de4b-4bfa-aee7-f5e1e7993181 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:49.589880 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-da81108f-de4b-4bfa-aee7-f5e1e7993181 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:49.598300 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-da81108f-de4b-4bfa-aee7-f5e1e7993181 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:49.599080 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-da81108f-de4b-4bfa-aee7-f5e1e7993181 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:49.599853 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-da81108f-de4b-4bfa-aee7-f5e1e7993181 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:49.600660 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-da81108f-de4b-4bfa-aee7-f5e1e7993181 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:49.625490 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dbb9c1aa-51fb-4a85-854a-191ace92d11b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:49.627163 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dbb9c1aa-51fb-4a85-854a-191ace92d11b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:49.634792 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dbb9c1aa-51fb-4a85-854a-191ace92d11b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:49.635867 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dbb9c1aa-51fb-4a85-854a-191ace92d11b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:49.636891 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dbb9c1aa-51fb-4a85-854a-191ace92d11b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:49.637985 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dbb9c1aa-51fb-4a85-854a-191ace92d11b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:49.670645 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-da81108f-de4b-4bfa-aee7-f5e1e7993181 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:49.679352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-da81108f-de4b-4bfa-aee7-f5e1e7993181 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1316 microversion: 2.1 time: 0.094057 Jun 28 03:25:49.689159 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 420/843] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:49 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1316 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:49.798713 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dbb9c1aa-51fb-4a85-854a-191ace92d11b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:49.808761 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dbb9c1aa-51fb-4a85-854a-191ace92d11b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.188347 Jun 28 03:25:49.810380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 424/844] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:49 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:25:50.697808 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-de54fc19-957b-49c0-8290-be4d9eb8c306 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:50.699121 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-de54fc19-957b-49c0-8290-be4d9eb8c306 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:50.706550 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-de54fc19-957b-49c0-8290-be4d9eb8c306 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:50.707397 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-de54fc19-957b-49c0-8290-be4d9eb8c306 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:50.708433 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-de54fc19-957b-49c0-8290-be4d9eb8c306 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:50.709100 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-de54fc19-957b-49c0-8290-be4d9eb8c306 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:50.828361 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fac9663f-1b33-41dd-a346-858a55db9223 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:50.829697 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fac9663f-1b33-41dd-a346-858a55db9223 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:50.838234 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fac9663f-1b33-41dd-a346-858a55db9223 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:50.839446 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fac9663f-1b33-41dd-a346-858a55db9223 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:50.840759 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fac9663f-1b33-41dd-a346-858a55db9223 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:50.841484 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fac9663f-1b33-41dd-a346-858a55db9223 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:50.895962 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-de54fc19-957b-49c0-8290-be4d9eb8c306 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:50.907669 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-de54fc19-957b-49c0-8290-be4d9eb8c306 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.214119 Jun 28 03:25:50.908590 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 421/845] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:50 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:50.992985 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fac9663f-1b33-41dd-a346-858a55db9223 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:51.001331 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fac9663f-1b33-41dd-a346-858a55db9223 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.177787 Jun 28 03:25:51.011859 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 425/846] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:50 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:51.928243 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7a92162a-6600-47d7-9953-29c62c2b27c3 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:51.929626 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7a92162a-6600-47d7-9953-29c62c2b27c3 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:51.937650 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7a92162a-6600-47d7-9953-29c62c2b27c3 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:51.938366 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7a92162a-6600-47d7-9953-29c62c2b27c3 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:51.939600 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7a92162a-6600-47d7-9953-29c62c2b27c3 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:51.940288 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7a92162a-6600-47d7-9953-29c62c2b27c3 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:52.019199 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2f15ecb9-cb91-4fcd-9b5d-aca7e080e829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:52.020388 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2f15ecb9-cb91-4fcd-9b5d-aca7e080e829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:52.027148 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2f15ecb9-cb91-4fcd-9b5d-aca7e080e829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:52.027595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2f15ecb9-cb91-4fcd-9b5d-aca7e080e829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:52.028402 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2f15ecb9-cb91-4fcd-9b5d-aca7e080e829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:52.028833 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2f15ecb9-cb91-4fcd-9b5d-aca7e080e829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:52.108528 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7a92162a-6600-47d7-9953-29c62c2b27c3 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:52.116860 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7a92162a-6600-47d7-9953-29c62c2b27c3 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.193992 Jun 28 03:25:52.128215 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 422/847] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:51 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:52.183630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2f15ecb9-cb91-4fcd-9b5d-aca7e080e829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:52.192278 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2f15ecb9-cb91-4fcd-9b5d-aca7e080e829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.176889 Jun 28 03:25:52.192854 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 426/848] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:52 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:25:53.135156 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-428a29e1-36d6-4535-9e50-8d27ee47f6a0 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:53.135769 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-428a29e1-36d6-4535-9e50-8d27ee47f6a0 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:53.142718 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-428a29e1-36d6-4535-9e50-8d27ee47f6a0 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:53.143172 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-428a29e1-36d6-4535-9e50-8d27ee47f6a0 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:53.143983 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-428a29e1-36d6-4535-9e50-8d27ee47f6a0 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:53.144485 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-428a29e1-36d6-4535-9e50-8d27ee47f6a0 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:53.209954 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bc4ace46-828e-4b65-8aad-3211ee1b7664 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:53.210669 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-bc4ace46-828e-4b65-8aad-3211ee1b7664 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:53.217534 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bc4ace46-828e-4b65-8aad-3211ee1b7664 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:53.218421 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bc4ace46-828e-4b65-8aad-3211ee1b7664 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:53.219440 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bc4ace46-828e-4b65-8aad-3211ee1b7664 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:53.220087 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bc4ace46-828e-4b65-8aad-3211ee1b7664 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:53.351771 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-428a29e1-36d6-4535-9e50-8d27ee47f6a0 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:53.360137 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-428a29e1-36d6-4535-9e50-8d27ee47f6a0 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.228873 Jun 28 03:25:53.360773 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 423/849] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:53 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:53.392995 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-bc4ace46-828e-4b65-8aad-3211ee1b7664 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:53.402404 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-bc4ace46-828e-4b65-8aad-3211ee1b7664 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.196282 Jun 28 03:25:53.403193 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 427/850] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:53 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:25:54.377868 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-26101580-159a-4a24-9c1f-1aa1728636fa tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:54.379836 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-26101580-159a-4a24-9c1f-1aa1728636fa tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:54.388289 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-26101580-159a-4a24-9c1f-1aa1728636fa tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:54.388816 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-26101580-159a-4a24-9c1f-1aa1728636fa tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:54.389657 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-26101580-159a-4a24-9c1f-1aa1728636fa tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:54.390175 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-26101580-159a-4a24-9c1f-1aa1728636fa tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:54.421169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7566be7e-0f01-4b66-8a41-a80f97d4c67d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:54.422689 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7566be7e-0f01-4b66-8a41-a80f97d4c67d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:54.430154 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7566be7e-0f01-4b66-8a41-a80f97d4c67d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:54.430953 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7566be7e-0f01-4b66-8a41-a80f97d4c67d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:54.431939 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7566be7e-0f01-4b66-8a41-a80f97d4c67d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:54.432395 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7566be7e-0f01-4b66-8a41-a80f97d4c67d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:54.590001 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-26101580-159a-4a24-9c1f-1aa1728636fa tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:54.599699 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-26101580-159a-4a24-9c1f-1aa1728636fa tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.226092 Jun 28 03:25:54.601677 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 424/851] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:54 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:54.622207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7566be7e-0f01-4b66-8a41-a80f97d4c67d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:54.631846 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7566be7e-0f01-4b66-8a41-a80f97d4c67d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.214746 Jun 28 03:25:54.642078 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 428/852] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:54 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:55.618660 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e5a73f50-6b22-45ba-acb9-a0ca78bd1262 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:55.619535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e5a73f50-6b22-45ba-acb9-a0ca78bd1262 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:55.626204 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e5a73f50-6b22-45ba-acb9-a0ca78bd1262 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:55.626649 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e5a73f50-6b22-45ba-acb9-a0ca78bd1262 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:55.627401 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e5a73f50-6b22-45ba-acb9-a0ca78bd1262 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:55.627829 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e5a73f50-6b22-45ba-acb9-a0ca78bd1262 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:55.649199 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-434d0c7d-076b-4a43-b0e6-90610be47842 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:55.650566 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-434d0c7d-076b-4a43-b0e6-90610be47842 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:55.658014 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-434d0c7d-076b-4a43-b0e6-90610be47842 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:55.658840 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-434d0c7d-076b-4a43-b0e6-90610be47842 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:55.659870 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-434d0c7d-076b-4a43-b0e6-90610be47842 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:55.660546 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-434d0c7d-076b-4a43-b0e6-90610be47842 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:55.847773 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-e5a73f50-6b22-45ba-acb9-a0ca78bd1262 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:55.856101 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-434d0c7d-076b-4a43-b0e6-90610be47842 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:55.858248 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e5a73f50-6b22-45ba-acb9-a0ca78bd1262 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.243692 Jun 28 03:25:55.859105 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 425/853] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:55 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:55.871613 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-434d0c7d-076b-4a43-b0e6-90610be47842 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.226292 Jun 28 03:25:55.872889 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 429/854] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:55 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:56.875452 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-de9b823a-890b-4b2a-bddf-fe7da510625b tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:56.876309 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-de9b823a-890b-4b2a-bddf-fe7da510625b tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:56.883732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-de9b823a-890b-4b2a-bddf-fe7da510625b tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:56.891121 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-34a08a82-2388-4fb0-b384-d38d2b87f59f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:56.891771 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-34a08a82-2388-4fb0-b384-d38d2b87f59f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:56.895257 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-de9b823a-890b-4b2a-bddf-fe7da510625b tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:56.896561 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-de9b823a-890b-4b2a-bddf-fe7da510625b tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:56.897066 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-de9b823a-890b-4b2a-bddf-fe7da510625b tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:56.904792 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-34a08a82-2388-4fb0-b384-d38d2b87f59f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:56.905233 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-34a08a82-2388-4fb0-b384-d38d2b87f59f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:56.906006 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-34a08a82-2388-4fb0-b384-d38d2b87f59f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:56.906432 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-34a08a82-2388-4fb0-b384-d38d2b87f59f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:57.118133 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-34a08a82-2388-4fb0-b384-d38d2b87f59f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:57.121150 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-de9b823a-890b-4b2a-bddf-fe7da510625b tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:57.122134 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:57.127113 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-34a08a82-2388-4fb0-b384-d38d2b87f59f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.239934 Jun 28 03:25:57.127706 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 430/855] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:56 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:57.129493 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-de9b823a-890b-4b2a-bddf-fe7da510625b tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.257804 Jun 28 03:25:57.130158 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 426/856] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:56 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:58.146693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c8cd1076-07eb-4870-bc93-f6475130fd6e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:58.147439 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7e0dbb9d-f0a0-468c-ab1a-3649388bf971 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:58.147817 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c8cd1076-07eb-4870-bc93-f6475130fd6e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:58.147950 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7e0dbb9d-f0a0-468c-ab1a-3649388bf971 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:58.149234 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=4 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:58.154621 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c8cd1076-07eb-4870-bc93-f6475130fd6e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:58.155062 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c8cd1076-07eb-4870-bc93-f6475130fd6e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:58.155825 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c8cd1076-07eb-4870-bc93-f6475130fd6e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:58.155944 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7e0dbb9d-f0a0-468c-ab1a-3649388bf971 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:58.156285 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c8cd1076-07eb-4870-bc93-f6475130fd6e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:58.156400 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7e0dbb9d-f0a0-468c-ab1a-3649388bf971 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:58.157038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7e0dbb9d-f0a0-468c-ab1a-3649388bf971 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:58.157454 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7e0dbb9d-f0a0-468c-ab1a-3649388bf971 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:58.349168 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7e0dbb9d-f0a0-468c-ab1a-3649388bf971 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:58.352578 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c8cd1076-07eb-4870-bc93-f6475130fd6e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:58.356138 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:58.359494 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7e0dbb9d-f0a0-468c-ab1a-3649388bf971 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1725 microversion: 2.1 time: 0.217568 Jun 28 03:25:58.360204 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 431/857] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:58 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:58.361094 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c8cd1076-07eb-4870-bc93-f6475130fd6e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.218988 Jun 28 03:25:58.370386 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 427/858] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:58 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:59.378309 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-acc87d8d-7714-4d87-8865-e4c16eedb167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:59.378906 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-cec1c1a2-80c3-44a1-997f-b54b1354468f tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:59.379679 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-acc87d8d-7714-4d87-8865-e4c16eedb167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:59.379836 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-cec1c1a2-80c3-44a1-997f-b54b1354468f tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:59.386803 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:59.387018 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-acc87d8d-7714-4d87-8865-e4c16eedb167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:59.387496 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-acc87d8d-7714-4d87-8865-e4c16eedb167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:59.387870 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=8 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:25:59.389162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-acc87d8d-7714-4d87-8865-e4c16eedb167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:59.389869 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-acc87d8d-7714-4d87-8865-e4c16eedb167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:59.391507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-cec1c1a2-80c3-44a1-997f-b54b1354468f tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:59.391926 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-cec1c1a2-80c3-44a1-997f-b54b1354468f tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:59.393015 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-cec1c1a2-80c3-44a1-997f-b54b1354468f tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:59.393679 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-cec1c1a2-80c3-44a1-997f-b54b1354468f tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:59.587355 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-acc87d8d-7714-4d87-8865-e4c16eedb167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:59.603072 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-acc87d8d-7714-4d87-8865-e4c16eedb167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1702 microversion: 2.1 time: 0.226435 Jun 28 03:25:59.603643 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 432/859] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:59 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1702 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:59.609748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-845f243a-b1bc-4c48-ab33-49f7519b964c req-e01ce192-f78e-4656-be0e-400470766a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ecdfcc-81dd-49db-9252-679712c4ec3b", "tag": "77b5c16f-bdac-49d8-a3cd-4445b397c792"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:25:59.620479 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-845f243a-b1bc-4c48-ab33-49f7519b964c req-e01ce192-f78e-4656-be0e-400470766a67 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:59.621187 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-845f243a-b1bc-4c48-ab33-49f7519b964c req-e01ce192-f78e-4656-be0e-400470766a67 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:59.636477 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-845f243a-b1bc-4c48-ab33-49f7519b964c req-e01ce192-f78e-4656-be0e-400470766a67 service nova] Creating event network-changed:77b5c16f-bdac-49d8-a3cd-4445b397c792 for instance b2ecdfcc-81dd-49db-9252-679712c4ec3b on hv-cinder-84684 Jun 28 03:25:59.636908 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-cec1c1a2-80c3-44a1-997f-b54b1354468f tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:59.647547 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-cec1c1a2-80c3-44a1-997f-b54b1354468f tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.272610 Jun 28 03:25:59.648255 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-845f243a-b1bc-4c48-ab33-49f7519b964c req-e01ce192-f78e-4656-be0e-400470766a67 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041180 Jun 28 03:25:59.649502 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 433/860] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:25:59.653195 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 428/861] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:59 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:25:59.658392 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-be5011f5-412f-42ae-ba28-1675b609f318 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:25:59.665940 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be5011f5-412f-42ae-ba28-1675b609f318 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:59.666384 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be5011f5-412f-42ae-ba28-1675b609f318 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:59.731469 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-be5011f5-412f-42ae-ba28-1675b609f318 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Going to try to start instance {{(pid=117680) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 28 03:25:59.786041 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-be5011f5-412f-42ae-ba28-1675b609f318 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "POST /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/action" status: 202 len: 0 microversion: 2.1 time: 0.134254 Jun 28 03:25:59.786809 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 434/862] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:25:59 2022] POST /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:25:59.795296 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-19e838e4-8b8d-48a6-b90e-efa695c0af67 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:25:59.796256 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-19e838e4-8b8d-48a6-b90e-efa695c0af67 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:25:59.803383 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-19e838e4-8b8d-48a6-b90e-efa695c0af67 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:59.804118 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-19e838e4-8b8d-48a6-b90e-efa695c0af67 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:59.805177 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-19e838e4-8b8d-48a6-b90e-efa695c0af67 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:25:59.805812 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-19e838e4-8b8d-48a6-b90e-efa695c0af67 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:25:59.946505 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-19e838e4-8b8d-48a6-b90e-efa695c0af67 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:25:59.954495 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-19e838e4-8b8d-48a6-b90e-efa695c0af67 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1711 microversion: 2.1 time: 0.163465 Jun 28 03:25:59.955057 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 429/863] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:25:59 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1711 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:26:00.667745 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d6de4d7d-15e7-4b5b-a8c7-3fb1317b154d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:00.668574 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d6de4d7d-15e7-4b5b-a8c7-3fb1317b154d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:00.678803 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d6de4d7d-15e7-4b5b-a8c7-3fb1317b154d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:00.679371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d6de4d7d-15e7-4b5b-a8c7-3fb1317b154d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:00.680538 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d6de4d7d-15e7-4b5b-a8c7-3fb1317b154d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:00.681058 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d6de4d7d-15e7-4b5b-a8c7-3fb1317b154d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:00.821064 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d6de4d7d-15e7-4b5b-a8c7-3fb1317b154d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:00.828936 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d6de4d7d-15e7-4b5b-a8c7-3fb1317b154d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.166957 Jun 28 03:26:00.829493 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 435/864] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:00 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:00.978722 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-67998329-541c-4203-89df-5b789d36bb1f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:00.979624 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-67998329-541c-4203-89df-5b789d36bb1f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:00.990756 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-67998329-541c-4203-89df-5b789d36bb1f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:00.991206 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-67998329-541c-4203-89df-5b789d36bb1f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:00.991968 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-67998329-541c-4203-89df-5b789d36bb1f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:00.992435 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-67998329-541c-4203-89df-5b789d36bb1f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:01.138348 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-67998329-541c-4203-89df-5b789d36bb1f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:01.146821 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-67998329-541c-4203-89df-5b789d36bb1f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1711 microversion: 2.1 time: 0.176053 Jun 28 03:26:01.147388 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 430/865] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:00 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1711 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:01.846066 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-665cab2b-8123-4b4a-8385-eb8464ab589d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:01.846937 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-665cab2b-8123-4b4a-8385-eb8464ab589d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:01.854981 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-665cab2b-8123-4b4a-8385-eb8464ab589d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:01.855488 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-665cab2b-8123-4b4a-8385-eb8464ab589d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:01.856356 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-665cab2b-8123-4b4a-8385-eb8464ab589d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:01.856946 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-665cab2b-8123-4b4a-8385-eb8464ab589d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:01.994241 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-665cab2b-8123-4b4a-8385-eb8464ab589d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:02.002099 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-665cab2b-8123-4b4a-8385-eb8464ab589d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.159963 Jun 28 03:26:02.002669 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 436/866] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:01 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:02.169668 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a89b1fdf-abb6-4d7d-8b26-fc2f76e5b65d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:02.170303 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a89b1fdf-abb6-4d7d-8b26-fc2f76e5b65d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:02.178306 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a89b1fdf-abb6-4d7d-8b26-fc2f76e5b65d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:02.178778 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a89b1fdf-abb6-4d7d-8b26-fc2f76e5b65d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:02.179561 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a89b1fdf-abb6-4d7d-8b26-fc2f76e5b65d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:02.179994 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a89b1fdf-abb6-4d7d-8b26-fc2f76e5b65d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:02.323371 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a89b1fdf-abb6-4d7d-8b26-fc2f76e5b65d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:02.331963 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a89b1fdf-abb6-4d7d-8b26-fc2f76e5b65d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1711 microversion: 2.1 time: 0.166282 Jun 28 03:26:02.332540 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 431/867] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:02 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1711 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:03.023092 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ec949004-3d4d-4052-879c-09975ed49236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:03.023702 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ec949004-3d4d-4052-879c-09975ed49236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:03.030750 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec949004-3d4d-4052-879c-09975ed49236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:03.031187 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec949004-3d4d-4052-879c-09975ed49236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:03.031932 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec949004-3d4d-4052-879c-09975ed49236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:03.032412 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec949004-3d4d-4052-879c-09975ed49236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:03.169311 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ec949004-3d4d-4052-879c-09975ed49236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:03.177342 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ec949004-3d4d-4052-879c-09975ed49236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.159524 Jun 28 03:26:03.177842 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 437/868] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:03 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:03.349594 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6145cc94-04e0-4245-b6b0-76304fef5c8b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:03.350555 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6145cc94-04e0-4245-b6b0-76304fef5c8b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:03.357221 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6145cc94-04e0-4245-b6b0-76304fef5c8b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:03.357659 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6145cc94-04e0-4245-b6b0-76304fef5c8b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:03.358396 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6145cc94-04e0-4245-b6b0-76304fef5c8b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:03.358822 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6145cc94-04e0-4245-b6b0-76304fef5c8b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:03.494936 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6145cc94-04e0-4245-b6b0-76304fef5c8b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:03.503299 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6145cc94-04e0-4245-b6b0-76304fef5c8b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1711 microversion: 2.1 time: 0.157627 Jun 28 03:26:03.503863 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 432/869] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:03 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1711 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:04.194695 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bf485aa3-c402-4f73-9de7-d4b8ccf9ba5c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:04.195305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-bf485aa3-c402-4f73-9de7-d4b8ccf9ba5c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:04.202329 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bf485aa3-c402-4f73-9de7-d4b8ccf9ba5c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:04.202774 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bf485aa3-c402-4f73-9de7-d4b8ccf9ba5c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:04.203519 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bf485aa3-c402-4f73-9de7-d4b8ccf9ba5c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:04.203939 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bf485aa3-c402-4f73-9de7-d4b8ccf9ba5c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:04.351716 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-bf485aa3-c402-4f73-9de7-d4b8ccf9ba5c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:04.359842 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-bf485aa3-c402-4f73-9de7-d4b8ccf9ba5c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.169125 Jun 28 03:26:04.360457 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 438/870] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:04 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:04.522930 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-46584e69-2255-4e58-bf3e-18bdc4b4f835 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:04.523474 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-46584e69-2255-4e58-bf3e-18bdc4b4f835 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:04.530453 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-46584e69-2255-4e58-bf3e-18bdc4b4f835 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:04.530902 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-46584e69-2255-4e58-bf3e-18bdc4b4f835 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:04.531658 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-46584e69-2255-4e58-bf3e-18bdc4b4f835 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:04.532092 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-46584e69-2255-4e58-bf3e-18bdc4b4f835 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:04.664483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-46584e69-2255-4e58-bf3e-18bdc4b4f835 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:04.672605 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-46584e69-2255-4e58-bf3e-18bdc4b4f835 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1715 microversion: 2.1 time: 0.155123 Jun 28 03:26:04.673138 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 433/871] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:04 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:04.822127 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-4d3e0599-2196-4f74-89dd-48a821d60c2c req-52c8fffa-3d9d-4337-8796-41551c8a1b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ecdfcc-81dd-49db-9252-679712c4ec3b", "name": "network-vif-plugged", "status": "completed", "tag": "77b5c16f-bdac-49d8-a3cd-4445b397c792"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:26:04.832316 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-4d3e0599-2196-4f74-89dd-48a821d60c2c req-52c8fffa-3d9d-4337-8796-41551c8a1b8f service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:04.832987 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-4d3e0599-2196-4f74-89dd-48a821d60c2c req-52c8fffa-3d9d-4337-8796-41551c8a1b8f service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:04.845361 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-4d3e0599-2196-4f74-89dd-48a821d60c2c req-52c8fffa-3d9d-4337-8796-41551c8a1b8f service nova] Creating event network-vif-plugged:77b5c16f-bdac-49d8-a3cd-4445b397c792 for instance b2ecdfcc-81dd-49db-9252-679712c4ec3b on hv-cinder-84684 Jun 28 03:26:04.851261 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-4d3e0599-2196-4f74-89dd-48a821d60c2c req-52c8fffa-3d9d-4337-8796-41551c8a1b8f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034435 Jun 28 03:26:04.852012 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 439/872] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:26:05.381891 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4be9b6bc-0bba-4ff9-852f-92f09b7389e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:05.382820 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4be9b6bc-0bba-4ff9-852f-92f09b7389e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:05.392830 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4be9b6bc-0bba-4ff9-852f-92f09b7389e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:05.393579 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4be9b6bc-0bba-4ff9-852f-92f09b7389e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:05.394835 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4be9b6bc-0bba-4ff9-852f-92f09b7389e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:05.395642 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4be9b6bc-0bba-4ff9-852f-92f09b7389e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:05.538189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4be9b6bc-0bba-4ff9-852f-92f09b7389e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:05.546009 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4be9b6bc-0bba-4ff9-852f-92f09b7389e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.170853 Jun 28 03:26:05.546573 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 434/873] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:05 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:06.563586 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cd778216-edaf-4095-9847-9dfdf4da506e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:06.564264 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cd778216-edaf-4095-9847-9dfdf4da506e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:06.571461 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd778216-edaf-4095-9847-9dfdf4da506e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:06.571899 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd778216-edaf-4095-9847-9dfdf4da506e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:06.572688 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd778216-edaf-4095-9847-9dfdf4da506e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:06.573110 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd778216-edaf-4095-9847-9dfdf4da506e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:06.712269 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cd778216-edaf-4095-9847-9dfdf4da506e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:06.720029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cd778216-edaf-4095-9847-9dfdf4da506e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1356 microversion: 2.1 time: 0.160692 Jun 28 03:26:06.720669 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 440/874] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:06 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:07.741102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-38521602-59e2-432c-b5a7-774986c8074a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:07.741713 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-38521602-59e2-432c-b5a7-774986c8074a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:07.744097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:07.749912 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-38521602-59e2-432c-b5a7-774986c8074a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:07.750352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-38521602-59e2-432c-b5a7-774986c8074a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:07.751106 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-38521602-59e2-432c-b5a7-774986c8074a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:07.751532 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-38521602-59e2-432c-b5a7-774986c8074a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:07.891829 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-38521602-59e2-432c-b5a7-774986c8074a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:07.900136 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-38521602-59e2-432c-b5a7-774986c8074a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1546 microversion: 2.1 time: 0.165057 Jun 28 03:26:07.900801 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 435/875] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:07 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:07.916595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d71d768b-4095-4d7d-a9d8-16713ae99a8c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:07.917198 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d71d768b-4095-4d7d-a9d8-16713ae99a8c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:07.919658 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:07.925768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d71d768b-4095-4d7d-a9d8-16713ae99a8c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:07.926199 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d71d768b-4095-4d7d-a9d8-16713ae99a8c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:07.927480 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d71d768b-4095-4d7d-a9d8-16713ae99a8c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:07.927918 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d71d768b-4095-4d7d-a9d8-16713ae99a8c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:08.077290 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d71d768b-4095-4d7d-a9d8-16713ae99a8c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:08.085210 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d71d768b-4095-4d7d-a9d8-16713ae99a8c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1546 microversion: 2.1 time: 0.172539 Jun 28 03:26:08.085782 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 441/876] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:07 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1546 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:08.101582 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-db1f3970-d880-4dbb-8c21-f60c02dff7b5 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:08.104919 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-db1f3970-d880-4dbb-8c21-f60c02dff7b5 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:08.105678 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-db1f3970-d880-4dbb-8c21-f60c02dff7b5 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Searching by: {'deleted': False, 'project_id': '75fde21fa6204de6976409a0d1c4c754'} {{(pid=117681) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 28 03:26:08.112682 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-db1f3970-d880-4dbb-8c21-f60c02dff7b5 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:08.113098 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-db1f3970-d880-4dbb-8c21-f60c02dff7b5 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:08.114112 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-db1f3970-d880-4dbb-8c21-f60c02dff7b5 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:08.114548 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-db1f3970-d880-4dbb-8c21-f60c02dff7b5 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:08.205806 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.multi_cell_list [None req-db1f3970-d880-4dbb-8c21-f60c02dff7b5 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117681) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 28 03:26:08.298600 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-db1f3970-d880-4dbb-8c21-f60c02dff7b5 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.201450 Jun 28 03:26:08.299204 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 436/877] 10.222.0.44 () {58 vars in 1124 bytes} [Tue Jun 28 03:26:08 2022] GET /compute/v2.1/servers => generated 341 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:26:08.309610 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-339cb265-7d68-458a-a132-b02817572b97 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:08.310188 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-339cb265-7d68-458a-a132-b02817572b97 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:08.316823 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-339cb265-7d68-458a-a132-b02817572b97 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:08.317321 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-339cb265-7d68-458a-a132-b02817572b97 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:08.318071 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-339cb265-7d68-458a-a132-b02817572b97 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:08.318501 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-339cb265-7d68-458a-a132-b02817572b97 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:08.446405 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-339cb265-7d68-458a-a132-b02817572b97 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:08.454350 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-339cb265-7d68-458a-a132-b02817572b97 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1546 microversion: 2.1 time: 0.148570 Jun 28 03:26:08.454972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 442/878] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:08 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1546 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:10.005098 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c7e9d4de-6b82-4085-966c-94736f18f216 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2737970-20a9-4c22-9cb3-04713f63b662"}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:26:10.006285 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c7e9d4de-6b82-4085-966c-94736f18f216 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:10.015181 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7e9d4de-6b82-4085-966c-94736f18f216 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:10.015728 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7e9d4de-6b82-4085-966c-94736f18f216 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:10.016516 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7e9d4de-6b82-4085-966c-94736f18f216 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:10.016946 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7e9d4de-6b82-4085-966c-94736f18f216 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:10.303920 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c7e9d4de-6b82-4085-966c-94736f18f216 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "POST /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302664 Jun 28 03:26:10.304534 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 437/879] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:26:09 2022] POST /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:26:17.912937 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c9e995ef-5863-47b2-affc-5090bac89123 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:17.913574 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c9e995ef-5863-47b2-affc-5090bac89123 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:17.920749 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c9e995ef-5863-47b2-affc-5090bac89123 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:17.921204 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c9e995ef-5863-47b2-affc-5090bac89123 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:17.921954 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c9e995ef-5863-47b2-affc-5090bac89123 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:17.922378 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c9e995ef-5863-47b2-affc-5090bac89123 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:18.077843 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c9e995ef-5863-47b2-affc-5090bac89123 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:18.089430 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c9e995ef-5863-47b2-affc-5090bac89123 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1592 microversion: 2.1 time: 0.180520 Jun 28 03:26:18.090009 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 443/880] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:17 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1592 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:26:19.765450 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:19.770915 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-b533ddf1-cc4a-4a57-a2e4-95f3757fdf9a req-60c1dc10-fbbc-4c47-9a0a-0b7d6c6f23c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ecdfcc-81dd-49db-9252-679712c4ec3b", "tag": "77b5c16f-bdac-49d8-a3cd-4445b397c792"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:26:19.781260 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-b533ddf1-cc4a-4a57-a2e4-95f3757fdf9a req-60c1dc10-fbbc-4c47-9a0a-0b7d6c6f23c2 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:19.781686 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-b533ddf1-cc4a-4a57-a2e4-95f3757fdf9a req-60c1dc10-fbbc-4c47-9a0a-0b7d6c6f23c2 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:19.793752 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-b533ddf1-cc4a-4a57-a2e4-95f3757fdf9a req-60c1dc10-fbbc-4c47-9a0a-0b7d6c6f23c2 service nova] Creating event network-changed:77b5c16f-bdac-49d8-a3cd-4445b397c792 for instance b2ecdfcc-81dd-49db-9252-679712c4ec3b on hv-cinder-84684 Jun 28 03:26:19.798970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-b533ddf1-cc4a-4a57-a2e4-95f3757fdf9a req-60c1dc10-fbbc-4c47-9a0a-0b7d6c6f23c2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034921 Jun 28 03:26:19.799812 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 438/881] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:26:20.762698 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-89e62217-733b-4d70-a502-2c1bcd60ba16 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-688633204"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:26:20.763240 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-89e62217-733b-4d70-a502-2c1bcd60ba16 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:20.769369 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-89e62217-733b-4d70-a502-2c1bcd60ba16 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:20.769807 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-89e62217-733b-4d70-a502-2c1bcd60ba16 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:20.770565 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-89e62217-733b-4d70-a502-2c1bcd60ba16 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:20.771007 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-89e62217-733b-4d70-a502-2c1bcd60ba16 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:20.904067 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.network.security_group_api [None req-89e62217-733b-4d70-a502-2c1bcd60ba16 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Adding security group 319330d3-4185-4027-ab3d-76a28cb577b9 to port 77b5c16f-bdac-49d8-a3cd-4445b397c792 Jun 28 03:26:21.255532 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-89e62217-733b-4d70-a502-2c1bcd60ba16 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "POST /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/action" status: 202 len: 0 microversion: 2.1 time: 0.496577 Jun 28 03:26:21.259285 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 444/882] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:26:20 2022] POST /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:26:21.267622 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-fbda281b-b524-49af-a00b-699e66cfa45d req-3e469b70-5a30-4668-9d48-74cbaa53bd52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ecdfcc-81dd-49db-9252-679712c4ec3b", "tag": "77b5c16f-bdac-49d8-a3cd-4445b397c792"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:26:21.273997 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-011a3a23-b783-4cf8-b0f4-e3b579b8a503 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:21.274527 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-011a3a23-b783-4cf8-b0f4-e3b579b8a503 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:21.292961 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-011a3a23-b783-4cf8-b0f4-e3b579b8a503 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:21.293422 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-011a3a23-b783-4cf8-b0f4-e3b579b8a503 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:21.294212 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-011a3a23-b783-4cf8-b0f4-e3b579b8a503 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:21.294648 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-011a3a23-b783-4cf8-b0f4-e3b579b8a503 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:21.295778 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-fbda281b-b524-49af-a00b-699e66cfa45d req-3e469b70-5a30-4668-9d48-74cbaa53bd52 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:21.296779 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-fbda281b-b524-49af-a00b-699e66cfa45d req-3e469b70-5a30-4668-9d48-74cbaa53bd52 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:21.314325 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-fbda281b-b524-49af-a00b-699e66cfa45d req-3e469b70-5a30-4668-9d48-74cbaa53bd52 service nova] Creating event network-changed:77b5c16f-bdac-49d8-a3cd-4445b397c792 for instance b2ecdfcc-81dd-49db-9252-679712c4ec3b on hv-cinder-84684 Jun 28 03:26:21.319866 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-fbda281b-b524-49af-a00b-699e66cfa45d req-3e469b70-5a30-4668-9d48-74cbaa53bd52 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059867 Jun 28 03:26:21.321284 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 439/883] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:26:21.467826 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-011a3a23-b783-4cf8-b0f4-e3b579b8a503 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:21.477660 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-011a3a23-b783-4cf8-b0f4-e3b579b8a503 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1757 microversion: 2.1 time: 0.213279 Jun 28 03:26:21.479052 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 445/884] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:21 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:42.769257 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f1d9dc55-c8bd-4a13-8fe3-5bdc4b7d1818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:42.769863 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f1d9dc55-c8bd-4a13-8fe3-5bdc4b7d1818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:42.772372 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=9 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:42.773037 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:42.778776 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f1d9dc55-c8bd-4a13-8fe3-5bdc4b7d1818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:42.779213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f1d9dc55-c8bd-4a13-8fe3-5bdc4b7d1818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:42.779973 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f1d9dc55-c8bd-4a13-8fe3-5bdc4b7d1818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:42.780430 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f1d9dc55-c8bd-4a13-8fe3-5bdc4b7d1818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:42.865193 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.objects.instance [None req-f1d9dc55-c8bd-4a13-8fe3-5bdc4b7d1818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lazy-loading 'services' on Instance uuid 785c405e-c17b-4e21-b51e-f645dd26f9b9 {{(pid=117681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:26:42.942291 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f1d9dc55-c8bd-4a13-8fe3-5bdc4b7d1818 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "DELETE /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/os-volume_attachments/bc2f4883-f227-453b-a61f-b81c24d5a834" status: 202 len: 0 microversion: 2.1 time: 0.179638 Jun 28 03:26:42.942872 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 440/885] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 28 03:26:42 2022] DELETE /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/os-volume_attachments/bc2f4883-f227-453b-a61f-b81c24d5a834 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:26:44.065318 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-806a8bfb-5b31-4186-9ca6-97e04fee3b39 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:26:44.067934 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=9 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:44.068652 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:44.074394 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-806a8bfb-5b31-4186-9ca6-97e04fee3b39 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:44.074835 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-806a8bfb-5b31-4186-9ca6-97e04fee3b39 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:44.097591 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-806a8bfb-5b31-4186-9ca6-97e04fee3b39 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Going to try to stop instance {{(pid=117680) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 28 03:26:44.142851 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-806a8bfb-5b31-4186-9ca6-97e04fee3b39 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "POST /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/action" status: 202 len: 0 microversion: 2.1 time: 0.081268 Jun 28 03:26:44.143481 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 446/886] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:26:44 2022] POST /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:26:44.153109 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2d5efea7-2f63-4d58-b07d-8961b48f07be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:44.153817 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2d5efea7-2f63-4d58-b07d-8961b48f07be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:44.160758 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2d5efea7-2f63-4d58-b07d-8961b48f07be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:44.161181 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2d5efea7-2f63-4d58-b07d-8961b48f07be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:44.161945 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2d5efea7-2f63-4d58-b07d-8961b48f07be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:44.162375 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2d5efea7-2f63-4d58-b07d-8961b48f07be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:44.304077 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2d5efea7-2f63-4d58-b07d-8961b48f07be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:44.315730 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2d5efea7-2f63-4d58-b07d-8961b48f07be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1679 microversion: 2.1 time: 0.166631 Jun 28 03:26:44.316544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 441/887] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:44 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:45.100621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-755f893f-c469-47b7-bacd-e6831fde8062 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:26:45.101546 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-755f893f-c469-47b7-bacd-e6831fde8062 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:45.108277 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-755f893f-c469-47b7-bacd-e6831fde8062 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:45.108712 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-755f893f-c469-47b7-bacd-e6831fde8062 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:45.109430 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-755f893f-c469-47b7-bacd-e6831fde8062 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:45.109881 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-755f893f-c469-47b7-bacd-e6831fde8062 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:45.186280 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-755f893f-c469-47b7-bacd-e6831fde8062 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "POST /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/action" status: 202 len: 0 microversion: 2.1 time: 0.093541 Jun 28 03:26:45.186934 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 447/888] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:26:45 2022] POST /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:26:45.201688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9612be0d-5c4b-4222-acf9-84d61789b5a4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:45.202329 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-9612be0d-5c4b-4222-acf9-84d61789b5a4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:45.210576 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9612be0d-5c4b-4222-acf9-84d61789b5a4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:45.211083 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9612be0d-5c4b-4222-acf9-84d61789b5a4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:45.212051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9612be0d-5c4b-4222-acf9-84d61789b5a4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:45.212512 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9612be0d-5c4b-4222-acf9-84d61789b5a4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:45.334423 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9240716a-fa15-4a38-b07c-4e026218008a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:45.335113 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9240716a-fa15-4a38-b07c-4e026218008a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:45.342468 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9240716a-fa15-4a38-b07c-4e026218008a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:45.342911 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9240716a-fa15-4a38-b07c-4e026218008a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:45.343670 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9240716a-fa15-4a38-b07c-4e026218008a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:45.344094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9240716a-fa15-4a38-b07c-4e026218008a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:45.359700 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9612be0d-5c4b-4222-acf9-84d61789b5a4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:45.368657 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-9612be0d-5c4b-4222-acf9-84d61789b5a4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1749 microversion: 2.1 time: 0.175984 Jun 28 03:26:45.369336 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 442/889] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:45 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1749 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:45.477230 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9240716a-fa15-4a38-b07c-4e026218008a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:45.485422 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9240716a-fa15-4a38-b07c-4e026218008a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1679 microversion: 2.1 time: 0.155599 Jun 28 03:26:45.485973 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 448/890] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:45 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:46.386471 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-98fb6bec-3eff-4b0b-b9ab-ba99cb41a0e4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:46.387128 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-98fb6bec-3eff-4b0b-b9ab-ba99cb41a0e4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:46.393712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-98fb6bec-3eff-4b0b-b9ab-ba99cb41a0e4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:46.394164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-98fb6bec-3eff-4b0b-b9ab-ba99cb41a0e4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:46.394913 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-98fb6bec-3eff-4b0b-b9ab-ba99cb41a0e4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:46.395342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-98fb6bec-3eff-4b0b-b9ab-ba99cb41a0e4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:46.502840 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-50465382-c695-48d3-8947-6b5cbf6104ca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:46.503422 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-50465382-c695-48d3-8947-6b5cbf6104ca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:46.510705 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-50465382-c695-48d3-8947-6b5cbf6104ca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:46.511111 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-50465382-c695-48d3-8947-6b5cbf6104ca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:46.511888 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-50465382-c695-48d3-8947-6b5cbf6104ca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:46.512343 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-50465382-c695-48d3-8947-6b5cbf6104ca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:46.546804 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-98fb6bec-3eff-4b0b-b9ab-ba99cb41a0e4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:46.555446 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-98fb6bec-3eff-4b0b-b9ab-ba99cb41a0e4 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1754 microversion: 2.1 time: 0.172918 Jun 28 03:26:46.556302 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 443/891] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:46 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:46.644746 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-50465382-c695-48d3-8947-6b5cbf6104ca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:46.654445 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-50465382-c695-48d3-8947-6b5cbf6104ca tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1679 microversion: 2.1 time: 0.155195 Jun 28 03:26:46.655106 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 449/892] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:46 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:26:47.574809 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-282e92bb-9717-4311-9b98-11cc26577236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:47.575491 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-282e92bb-9717-4311-9b98-11cc26577236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:47.585918 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-282e92bb-9717-4311-9b98-11cc26577236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:47.586397 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-282e92bb-9717-4311-9b98-11cc26577236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:47.587213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-282e92bb-9717-4311-9b98-11cc26577236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:47.587673 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-282e92bb-9717-4311-9b98-11cc26577236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:47.674864 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-73d3f024-df51-4ce1-bbd4-3fd797813a13 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:47.675475 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-73d3f024-df51-4ce1-bbd4-3fd797813a13 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:47.683274 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-73d3f024-df51-4ce1-bbd4-3fd797813a13 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:47.683727 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-73d3f024-df51-4ce1-bbd4-3fd797813a13 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:47.684720 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-73d3f024-df51-4ce1-bbd4-3fd797813a13 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:47.685155 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-73d3f024-df51-4ce1-bbd4-3fd797813a13 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:47.795629 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-282e92bb-9717-4311-9b98-11cc26577236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:47.804261 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-282e92bb-9717-4311-9b98-11cc26577236 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1754 microversion: 2.1 time: 0.233568 Jun 28 03:26:47.804840 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 444/893] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:47 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1754 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:47.845700 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-73d3f024-df51-4ce1-bbd4-3fd797813a13 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:47.854065 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-73d3f024-df51-4ce1-bbd4-3fd797813a13 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1679 microversion: 2.1 time: 0.183245 Jun 28 03:26:47.854635 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 450/894] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:47 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:26:48.825828 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ab66ef18-78ff-4b71-90e2-00ff53c97573 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:48.826805 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ab66ef18-78ff-4b71-90e2-00ff53c97573 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:48.837952 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ab66ef18-78ff-4b71-90e2-00ff53c97573 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:48.838685 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ab66ef18-78ff-4b71-90e2-00ff53c97573 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:48.839931 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ab66ef18-78ff-4b71-90e2-00ff53c97573 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:48.840693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ab66ef18-78ff-4b71-90e2-00ff53c97573 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:48.870881 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8a89d3eb-dbd7-456c-9920-1d0065783beb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:48.871457 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8a89d3eb-dbd7-456c-9920-1d0065783beb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:48.878577 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8a89d3eb-dbd7-456c-9920-1d0065783beb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:48.879023 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8a89d3eb-dbd7-456c-9920-1d0065783beb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:48.879784 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8a89d3eb-dbd7-456c-9920-1d0065783beb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:48.880210 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8a89d3eb-dbd7-456c-9920-1d0065783beb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:49.046789 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ab66ef18-78ff-4b71-90e2-00ff53c97573 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:49.055710 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ab66ef18-78ff-4b71-90e2-00ff53c97573 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1754 microversion: 2.1 time: 0.236411 Jun 28 03:26:49.056319 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 445/895] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:48 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1754 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:49.070418 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8a89d3eb-dbd7-456c-9920-1d0065783beb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:49.078303 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8a89d3eb-dbd7-456c-9920-1d0065783beb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1679 microversion: 2.1 time: 0.211261 Jun 28 03:26:49.078834 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 451/896] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:48 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1679 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:50.077893 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-0186b3a4-93ae-4d21-b1ce-3f06acf13d98 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:50.078796 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-0186b3a4-93ae-4d21-b1ce-3f06acf13d98 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:50.088283 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0186b3a4-93ae-4d21-b1ce-3f06acf13d98 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:50.088723 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0186b3a4-93ae-4d21-b1ce-3f06acf13d98 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:50.089472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0186b3a4-93ae-4d21-b1ce-3f06acf13d98 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:50.089897 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-0186b3a4-93ae-4d21-b1ce-3f06acf13d98 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:50.095713 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5c992a52-c35c-4f4c-82c1-b1b932ab2a01 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:50.096334 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5c992a52-c35c-4f4c-82c1-b1b932ab2a01 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:50.103130 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c992a52-c35c-4f4c-82c1-b1b932ab2a01 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:50.103569 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c992a52-c35c-4f4c-82c1-b1b932ab2a01 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:50.104358 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c992a52-c35c-4f4c-82c1-b1b932ab2a01 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:50.104781 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c992a52-c35c-4f4c-82c1-b1b932ab2a01 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:50.305391 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5c992a52-c35c-4f4c-82c1-b1b932ab2a01 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:50.311047 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-0186b3a4-93ae-4d21-b1ce-3f06acf13d98 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:50.313759 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5c992a52-c35c-4f4c-82c1-b1b932ab2a01 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1679 microversion: 2.1 time: 0.221277 Jun 28 03:26:50.314572 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 452/897] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:50 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:50.319290 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-0186b3a4-93ae-4d21-b1ce-3f06acf13d98 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1754 microversion: 2.1 time: 0.248063 Jun 28 03:26:50.319955 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 446/898] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:50 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1754 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:51.335027 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-28861725-67df-4f86-bc1b-cce809e06829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:51.336009 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-28861725-67df-4f86-bc1b-cce809e06829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:51.339949 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9c973c8a-6dba-4c10-8493-f327db86235c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:51.340595 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-9c973c8a-6dba-4c10-8493-f327db86235c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:51.343071 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-28861725-67df-4f86-bc1b-cce809e06829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:51.343513 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-28861725-67df-4f86-bc1b-cce809e06829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:51.344303 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-28861725-67df-4f86-bc1b-cce809e06829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:51.344733 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-28861725-67df-4f86-bc1b-cce809e06829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:51.347431 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9c973c8a-6dba-4c10-8493-f327db86235c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:51.347881 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9c973c8a-6dba-4c10-8493-f327db86235c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:51.349083 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9c973c8a-6dba-4c10-8493-f327db86235c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:51.349520 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9c973c8a-6dba-4c10-8493-f327db86235c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:51.543208 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-28861725-67df-4f86-bc1b-cce809e06829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:51.551162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-28861725-67df-4f86-bc1b-cce809e06829 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1679 microversion: 2.1 time: 0.222695 Jun 28 03:26:51.551760 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 453/899] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:51 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1679 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:51.558166 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9c973c8a-6dba-4c10-8493-f327db86235c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:51.566541 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-9c973c8a-6dba-4c10-8493-f327db86235c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1754 microversion: 2.1 time: 0.232001 Jun 28 03:26:51.567080 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 447/900] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:51 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1754 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:52.572323 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b01bd847-86c5-4f22-a76e-4ca65e0e86a8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:52.573050 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b01bd847-86c5-4f22-a76e-4ca65e0e86a8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:52.581718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b01bd847-86c5-4f22-a76e-4ca65e0e86a8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:52.582280 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b01bd847-86c5-4f22-a76e-4ca65e0e86a8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:52.583214 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b01bd847-86c5-4f22-a76e-4ca65e0e86a8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:52.583749 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b01bd847-86c5-4f22-a76e-4ca65e0e86a8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:52.585787 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4e8742ec-a228-4f3c-bc17-aa42126063e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:52.586567 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4e8742ec-a228-4f3c-bc17-aa42126063e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:52.595033 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4e8742ec-a228-4f3c-bc17-aa42126063e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:52.595578 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4e8742ec-a228-4f3c-bc17-aa42126063e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:52.596525 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4e8742ec-a228-4f3c-bc17-aa42126063e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:52.597078 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4e8742ec-a228-4f3c-bc17-aa42126063e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:52.787949 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b01bd847-86c5-4f22-a76e-4ca65e0e86a8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:52.795801 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b01bd847-86c5-4f22-a76e-4ca65e0e86a8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1679 microversion: 2.1 time: 0.229788 Jun 28 03:26:52.796719 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 454/901] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:52 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:52.802590 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4e8742ec-a228-4f3c-bc17-aa42126063e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:52.810960 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4e8742ec-a228-4f3c-bc17-aa42126063e1 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1754 microversion: 2.1 time: 0.230025 Jun 28 03:26:52.811517 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 448/902] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:52 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1754 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:53.814671 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-88f2341f-25a9-4da2-9f9f-a082653b2cc4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:53.815293 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-88f2341f-25a9-4da2-9f9f-a082653b2cc4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:53.822794 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-88f2341f-25a9-4da2-9f9f-a082653b2cc4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:53.823247 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-88f2341f-25a9-4da2-9f9f-a082653b2cc4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:53.824090 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-88f2341f-25a9-4da2-9f9f-a082653b2cc4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:53.824556 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-88f2341f-25a9-4da2-9f9f-a082653b2cc4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:53.827760 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-798d0b30-e9c2-4b7c-99a4-2f7d6818885a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:53.828527 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-798d0b30-e9c2-4b7c-99a4-2f7d6818885a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:53.834808 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-798d0b30-e9c2-4b7c-99a4-2f7d6818885a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:53.835239 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-798d0b30-e9c2-4b7c-99a4-2f7d6818885a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:53.835985 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-798d0b30-e9c2-4b7c-99a4-2f7d6818885a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:53.836439 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-798d0b30-e9c2-4b7c-99a4-2f7d6818885a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:54.017532 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-88f2341f-25a9-4da2-9f9f-a082653b2cc4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:54.025472 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-88f2341f-25a9-4da2-9f9f-a082653b2cc4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1679 microversion: 2.1 time: 0.215782 Jun 28 03:26:54.026088 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 455/903] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:53 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:54.038546 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-798d0b30-e9c2-4b7c-99a4-2f7d6818885a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:54.048192 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-798d0b30-e9c2-4b7c-99a4-2f7d6818885a tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1754 microversion: 2.1 time: 0.224166 Jun 28 03:26:54.048754 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 449/904] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:53 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1754 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:55.046841 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8520c7df-1199-41d6-bb12-ffc10151e36c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:55.047393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8520c7df-1199-41d6-bb12-ffc10151e36c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:55.058129 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8520c7df-1199-41d6-bb12-ffc10151e36c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:55.058694 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8520c7df-1199-41d6-bb12-ffc10151e36c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:55.059650 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8520c7df-1199-41d6-bb12-ffc10151e36c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:55.060219 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8520c7df-1199-41d6-bb12-ffc10151e36c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:55.065537 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-85ee41df-3f7a-4a69-9902-159468262a41 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:55.066153 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-85ee41df-3f7a-4a69-9902-159468262a41 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:55.073128 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-85ee41df-3f7a-4a69-9902-159468262a41 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:55.073578 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-85ee41df-3f7a-4a69-9902-159468262a41 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:55.074629 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-85ee41df-3f7a-4a69-9902-159468262a41 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:55.075082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-85ee41df-3f7a-4a69-9902-159468262a41 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:55.265976 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8520c7df-1199-41d6-bb12-ffc10151e36c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:55.274116 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8520c7df-1199-41d6-bb12-ffc10151e36c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1656 microversion: 2.1 time: 0.234056 Jun 28 03:26:55.274777 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 456/905] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:55 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1656 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:55.280866 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-85ee41df-3f7a-4a69-9902-159468262a41 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:55.289667 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-85ee41df-3f7a-4a69-9902-159468262a41 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1754 microversion: 2.1 time: 0.228047 Jun 28 03:26:55.290217 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 450/906] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:55 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1754 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:26:55.291245 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2e8a6110-a88e-483f-ad79-ea3fa54217b6 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:26:55.297596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2e8a6110-a88e-483f-ad79-ea3fa54217b6 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:55.297977 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2e8a6110-a88e-483f-ad79-ea3fa54217b6 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:55.320304 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2e8a6110-a88e-483f-ad79-ea3fa54217b6 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Going to try to start instance {{(pid=117680) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 28 03:26:55.371205 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2e8a6110-a88e-483f-ad79-ea3fa54217b6 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "POST /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/action" status: 202 len: 0 microversion: 2.1 time: 0.083705 Jun 28 03:26:55.371826 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 457/907] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:26:55 2022] POST /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 03:26:55.380091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-80417d1d-cdbd-4146-b36e-fff1b71ef71e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:55.380726 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-80417d1d-cdbd-4146-b36e-fff1b71ef71e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:55.387497 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-80417d1d-cdbd-4146-b36e-fff1b71ef71e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:55.387984 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-80417d1d-cdbd-4146-b36e-fff1b71ef71e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:55.388853 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-80417d1d-cdbd-4146-b36e-fff1b71ef71e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:55.389322 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-80417d1d-cdbd-4146-b36e-fff1b71ef71e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:55.527949 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-80417d1d-cdbd-4146-b36e-fff1b71ef71e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:55.535948 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-80417d1d-cdbd-4146-b36e-fff1b71ef71e tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1665 microversion: 2.1 time: 0.159706 Jun 28 03:26:55.536544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 451/908] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:55 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:56.308322 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2c772e60-de5d-46da-a5ee-51f1dc4a9895 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:56.308991 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2c772e60-de5d-46da-a5ee-51f1dc4a9895 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:56.315955 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2c772e60-de5d-46da-a5ee-51f1dc4a9895 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:56.316425 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2c772e60-de5d-46da-a5ee-51f1dc4a9895 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:56.317204 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2c772e60-de5d-46da-a5ee-51f1dc4a9895 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:56.317626 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2c772e60-de5d-46da-a5ee-51f1dc4a9895 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:56.468802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2c772e60-de5d-46da-a5ee-51f1dc4a9895 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:56.477274 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2c772e60-de5d-46da-a5ee-51f1dc4a9895 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1754 microversion: 2.1 time: 0.173808 Jun 28 03:26:56.477829 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 458/909] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:56 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:56.553652 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3a7a7932-6c45-4ec3-99e9-b49beea1229b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:56.554277 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-3a7a7932-6c45-4ec3-99e9-b49beea1229b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:56.561749 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3a7a7932-6c45-4ec3-99e9-b49beea1229b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:56.562446 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3a7a7932-6c45-4ec3-99e9-b49beea1229b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:56.563284 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3a7a7932-6c45-4ec3-99e9-b49beea1229b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:56.563709 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3a7a7932-6c45-4ec3-99e9-b49beea1229b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:56.701653 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-3a7a7932-6c45-4ec3-99e9-b49beea1229b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:56.709159 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3a7a7932-6c45-4ec3-99e9-b49beea1229b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1665 microversion: 2.1 time: 0.159527 Jun 28 03:26:56.709721 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 452/910] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:56 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:57.498327 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-887924db-452a-4891-b3fc-d97b0aab1074 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:57.498943 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-887924db-452a-4891-b3fc-d97b0aab1074 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:57.505968 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-887924db-452a-4891-b3fc-d97b0aab1074 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:57.506413 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-887924db-452a-4891-b3fc-d97b0aab1074 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:57.507166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-887924db-452a-4891-b3fc-d97b0aab1074 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:57.507591 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-887924db-452a-4891-b3fc-d97b0aab1074 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:57.527955 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:26:57.668889 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-887924db-452a-4891-b3fc-d97b0aab1074 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:57.677241 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-887924db-452a-4891-b3fc-d97b0aab1074 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1757 microversion: 2.1 time: 0.185415 Jun 28 03:26:57.677850 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 459/911] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:57 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:26:57.726904 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b7693452-fa52-4cab-a480-65f97a3ffc6f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:26:57.727627 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b7693452-fa52-4cab-a480-65f97a3ffc6f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:26:57.734863 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b7693452-fa52-4cab-a480-65f97a3ffc6f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:57.735309 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b7693452-fa52-4cab-a480-65f97a3ffc6f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:57.736083 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b7693452-fa52-4cab-a480-65f97a3ffc6f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:26:57.736544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b7693452-fa52-4cab-a480-65f97a3ffc6f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:26:57.874420 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b7693452-fa52-4cab-a480-65f97a3ffc6f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:26:57.882482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b7693452-fa52-4cab-a480-65f97a3ffc6f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1669 microversion: 2.1 time: 0.159808 Jun 28 03:26:57.883049 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 453/912] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:26:57 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:30.403344 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-77bb7f6d-fd15-40bd-b70a-3cb380c9a90e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-688633204"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:27:30.404484 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-77bb7f6d-fd15-40bd-b70a-3cb380c9a90e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:30.407798 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=28 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:27:30.408905 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:27:30.417121 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77bb7f6d-fd15-40bd-b70a-3cb380c9a90e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:30.417550 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77bb7f6d-fd15-40bd-b70a-3cb380c9a90e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:30.418315 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77bb7f6d-fd15-40bd-b70a-3cb380c9a90e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:30.418738 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77bb7f6d-fd15-40bd-b70a-3cb380c9a90e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:30.558522 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.network.security_group_api [None req-77bb7f6d-fd15-40bd-b70a-3cb380c9a90e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Removing security group 319330d3-4185-4027-ab3d-76a28cb577b9 from port 77b5c16f-bdac-49d8-a3cd-4445b397c792 Jun 28 03:27:30.931622 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-77bb7f6d-fd15-40bd-b70a-3cb380c9a90e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "POST /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/action" status: 202 len: 0 microversion: 2.1 time: 0.529630 Jun 28 03:27:30.933453 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 460/913] 10.222.0.44 () {60 vars in 1277 bytes} [Tue Jun 28 03:27:30 2022] POST /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:27:30.937141 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-d869c299-4dcd-473d-b331-c08aca7e44f0 req-e7137f8d-1a3c-4db6-922f-540995aee3ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ecdfcc-81dd-49db-9252-679712c4ec3b", "tag": "77b5c16f-bdac-49d8-a3cd-4445b397c792"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:27:30.945206 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=28 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:27:30.946380 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:27:30.948859 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-d869c299-4dcd-473d-b331-c08aca7e44f0 req-e7137f8d-1a3c-4db6-922f-540995aee3ff service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:30.949164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-d869c299-4dcd-473d-b331-c08aca7e44f0 req-e7137f8d-1a3c-4db6-922f-540995aee3ff service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:30.962846 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-d869c299-4dcd-473d-b331-c08aca7e44f0 req-e7137f8d-1a3c-4db6-922f-540995aee3ff service nova] Creating event network-changed:77b5c16f-bdac-49d8-a3cd-4445b397c792 for instance b2ecdfcc-81dd-49db-9252-679712c4ec3b on hv-cinder-84684 Jun 28 03:27:30.977760 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-d869c299-4dcd-473d-b331-c08aca7e44f0 req-e7137f8d-1a3c-4db6-922f-540995aee3ff service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044245 Jun 28 03:27:30.978715 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 454/914] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:27:32.305900 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-83746d95-0910-4e72-8722-f3375dc5ff6d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:32.306452 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-83746d95-0910-4e72-8722-f3375dc5ff6d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:32.312841 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-83746d95-0910-4e72-8722-f3375dc5ff6d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:32.313413 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-83746d95-0910-4e72-8722-f3375dc5ff6d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:32.314235 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-83746d95-0910-4e72-8722-f3375dc5ff6d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:32.314731 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-83746d95-0910-4e72-8722-f3375dc5ff6d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:32.397655 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-83746d95-0910-4e72-8722-f3375dc5ff6d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lazy-loading 'services' on Instance uuid b2ecdfcc-81dd-49db-9252-679712c4ec3b {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:27:32.471106 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-83746d95-0910-4e72-8722-f3375dc5ff6d tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/os-volume_attachments/e2737970-20a9-4c22-9cb3-04713f63b662" status: 202 len: 0 microversion: 2.1 time: 0.169703 Jun 28 03:27:32.471813 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 461/915] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 28 03:27:32 2022] DELETE /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/os-volume_attachments/e2737970-20a9-4c22-9cb3-04713f63b662 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:27:32.484064 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-96711364-b884-46b7-ab32-c47bfd540f79 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:32.485731 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-96711364-b884-46b7-ab32-c47bfd540f79 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:32.493406 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-96711364-b884-46b7-ab32-c47bfd540f79 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:32.494189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-96711364-b884-46b7-ab32-c47bfd540f79 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:32.495310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-96711364-b884-46b7-ab32-c47bfd540f79 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:32.495750 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-96711364-b884-46b7-ab32-c47bfd540f79 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:32.527043 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-96711364-b884-46b7-ab32-c47bfd540f79 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049233 Jun 28 03:27:32.527620 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 455/916] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:27:32 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:27:32.998350 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-ed0b586d-8b9a-434f-a8f0-111aad5699dd req-27ab6e08-7994-47f2-9ef9-79bcc8d915d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2ecdfcc-81dd-49db-9252-679712c4ec3b", "tag": "77b5c16f-bdac-49d8-a3cd-4445b397c792"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:27:33.008104 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-ed0b586d-8b9a-434f-a8f0-111aad5699dd req-27ab6e08-7994-47f2-9ef9-79bcc8d915d4 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:33.008566 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-ed0b586d-8b9a-434f-a8f0-111aad5699dd req-27ab6e08-7994-47f2-9ef9-79bcc8d915d4 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:33.021291 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-ed0b586d-8b9a-434f-a8f0-111aad5699dd req-27ab6e08-7994-47f2-9ef9-79bcc8d915d4 service nova] Creating event network-changed:77b5c16f-bdac-49d8-a3cd-4445b397c792 for instance b2ecdfcc-81dd-49db-9252-679712c4ec3b on hv-cinder-84684 Jun 28 03:27:33.026589 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-ed0b586d-8b9a-434f-a8f0-111aad5699dd req-27ab6e08-7994-47f2-9ef9-79bcc8d915d4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033324 Jun 28 03:27:33.027174 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 462/917] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:27:33.539201 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4ab3e606-ba51-433b-a984-9f20aba003ab tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:33.540095 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4ab3e606-ba51-433b-a984-9f20aba003ab tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:33.547023 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4ab3e606-ba51-433b-a984-9f20aba003ab tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:33.547437 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4ab3e606-ba51-433b-a984-9f20aba003ab tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:33.548222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4ab3e606-ba51-433b-a984-9f20aba003ab tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:33.548647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4ab3e606-ba51-433b-a984-9f20aba003ab tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:33.577213 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4ab3e606-ba51-433b-a984-9f20aba003ab tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042156 Jun 28 03:27:33.577994 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 456/918] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:27:33 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 03:27:33.588951 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d7717816-8f2e-4960-bb55-8e08a0753c0c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:33.589515 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d7717816-8f2e-4960-bb55-8e08a0753c0c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:33.595985 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d7717816-8f2e-4960-bb55-8e08a0753c0c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:33.596460 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d7717816-8f2e-4960-bb55-8e08a0753c0c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:33.597219 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d7717816-8f2e-4960-bb55-8e08a0753c0c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:33.597991 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d7717816-8f2e-4960-bb55-8e08a0753c0c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:33.681141 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-d7717816-8f2e-4960-bb55-8e08a0753c0c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] HTTP exception thrown: Instance b2ecdfcc-81dd-49db-9252-679712c4ec3b is not attached to volume e2737970-20a9-4c22-9cb3-04713f63b662 Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d7717816-8f2e-4960-bb55-8e08a0753c0c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Request method failure captured: Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: DELETE /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/os-volume_attachments/e2737970-20a9-4c22-9cb3-04713f63b662 HTTP/1.1 Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunSr7ax0dJpUipCNtNU0T28aArSkS3FSf0jll_B8m-qGMorpFpikS_WRbksNOPerzj6RhCzm-roqfW4TQsOzI9iMIphfx-ldRhC9EfcVS2fC2FlFM6-cksxl2LsZC-MY4dBvRP3yimhTgPyfeLb2FrxnElu_9x_PnNU3vFIK9S7SxGk Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 75fde21fa6204de6976409a0d1c4c754 Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-TestMinimumBasicScenario-1161928014 Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:27:33.683511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:27:33.685162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_75fde21fa6204de6976409a0d1c4c754", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/75fde21fa6204de6976409a0d1c4c754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/75fde21fa6204de6976409a0d1c4c754"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/75fde21fa6204de6976409a0d1c4c754"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:27:33.685162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-TestMinimumBasicScenario-1161928014 Jun 28 03:27:33.685162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 75fde21fa6204de6976409a0d1c4c754 Jun 28 03:27:33.685162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1161928014 Jun 28 03:27:33.685162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-TestMinimumBasicScenario-1161928014-project Jun 28 03:27:33.685162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:27:33.685162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:27:33.685162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: f85e7ea701184ef5951da92ecb4cb9ee Jun 28 03:27:33.685162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-TestMinimumBasicScenario-1161928014-project Jun 28 03:27:33.685162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:27:33.685162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance b2ecdfcc-81dd-49db-9252-679712c4ec3b is not attached to volume e2737970-20a9-4c22-9cb3-04713f63b662 Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'server_id': 'b2ecdfcc-81dd-49db-9252-679712c4ec3b', 'id': 'e2737970-20a9-4c22-9cb3-04713f63b662'} Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e2737970-20a9-4c22-9cb3-04713f63b662. Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:27:33.686038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ecdfcc-81dd-49db-9252-679712c4ec3b is not attached to volume e2737970-20a9-4c22-9cb3-04713f63b662 Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ecdfcc-81dd-49db-9252-679712c4ec3b is not attached to volume e2737970-20a9-4c22-9cb3-04713f63b662 Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:33.687507 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d7717816-8f2e-4960-bb55-8e08a0753c0c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Returning 404 to user: Instance b2ecdfcc-81dd-49db-9252-679712c4ec3b is not attached to volume e2737970-20a9-4c22-9cb3-04713f63b662 {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:27:33.688666 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d7717816-8f2e-4960-bb55-8e08a0753c0c tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/os-volume_attachments/e2737970-20a9-4c22-9cb3-04713f63b662" status: 404 len: 154 microversion: 2.1 time: 0.100879 Jun 28 03:27:33.688666 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 463/919] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 28 03:27:33 2022] DELETE /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b/os-volume_attachments/e2737970-20a9-4c22-9cb3-04713f63b662 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:27:34.841429 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d28d5bf0-1d07-420a-b011-3a67a4ee7a59 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:34.841951 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d28d5bf0-1d07-420a-b011-3a67a4ee7a59 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:34.849129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d28d5bf0-1d07-420a-b011-3a67a4ee7a59 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:34.849577 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d28d5bf0-1d07-420a-b011-3a67a4ee7a59 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:34.850320 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d28d5bf0-1d07-420a-b011-3a67a4ee7a59 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:34.850770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d28d5bf0-1d07-420a-b011-3a67a4ee7a59 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:34.875107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d28d5bf0-1d07-420a-b011-3a67a4ee7a59 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Going to try to terminate instance {{(pid=117681) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:27:34.954619 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d28d5bf0-1d07-420a-b011-3a67a4ee7a59 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 204 len: 0 microversion: 2.1 time: 0.116915 Jun 28 03:27:34.955397 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 457/920] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:27:34 2022] DELETE /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:27:34.963999 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2cbafed3-e1f3-45b5-a949-53e4b19ba885 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:34.964655 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2cbafed3-e1f3-45b5-a949-53e4b19ba885 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:34.971530 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2cbafed3-e1f3-45b5-a949-53e4b19ba885 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:34.971977 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2cbafed3-e1f3-45b5-a949-53e4b19ba885 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:34.973127 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2cbafed3-e1f3-45b5-a949-53e4b19ba885 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:34.973552 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2cbafed3-e1f3-45b5-a949-53e4b19ba885 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:35.101719 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2cbafed3-e1f3-45b5-a949-53e4b19ba885 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:35.109446 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2cbafed3-e1f3-45b5-a949-53e4b19ba885 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1552 microversion: 2.1 time: 0.149788 Jun 28 03:27:35.110000 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 464/921] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:34 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:36.132942 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-573eb7de-6a36-4e98-a4ef-5d1e99b38527 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:36.133702 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-573eb7de-6a36-4e98-a4ef-5d1e99b38527 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:36.148970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-573eb7de-6a36-4e98-a4ef-5d1e99b38527 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:36.149884 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-573eb7de-6a36-4e98-a4ef-5d1e99b38527 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:36.150676 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-573eb7de-6a36-4e98-a4ef-5d1e99b38527 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:36.151107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-573eb7de-6a36-4e98-a4ef-5d1e99b38527 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:36.302020 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-573eb7de-6a36-4e98-a4ef-5d1e99b38527 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:36.313634 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-573eb7de-6a36-4e98-a4ef-5d1e99b38527 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1552 microversion: 2.1 time: 0.188238 Jun 28 03:27:36.314459 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 458/922] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:36 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1552 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:36.413634 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e97faa5b-af92-4484-9500-7b12fc9a9a4c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:36.414581 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e97faa5b-af92-4484-9500-7b12fc9a9a4c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:36.422308 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e97faa5b-af92-4484-9500-7b12fc9a9a4c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:36.422733 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e97faa5b-af92-4484-9500-7b12fc9a9a4c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:36.423528 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e97faa5b-af92-4484-9500-7b12fc9a9a4c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:36.423958 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e97faa5b-af92-4484-9500-7b12fc9a9a4c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:36.458657 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e97faa5b-af92-4484-9500-7b12fc9a9a4c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050800 Jun 28 03:27:36.459211 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 465/923] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:27:36 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 03:27:36.532699 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-83d137a9-6a18-488e-8e94-5ee5c3b028b4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:36.533179 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-83d137a9-6a18-488e-8e94-5ee5c3b028b4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:36.539975 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-83d137a9-6a18-488e-8e94-5ee5c3b028b4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:36.540475 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-83d137a9-6a18-488e-8e94-5ee5c3b028b4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:36.541224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-83d137a9-6a18-488e-8e94-5ee5c3b028b4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:36.541648 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-83d137a9-6a18-488e-8e94-5ee5c3b028b4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:36.566868 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-83d137a9-6a18-488e-8e94-5ee5c3b028b4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Going to try to terminate instance {{(pid=117681) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:27:36.646543 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-83d137a9-6a18-488e-8e94-5ee5c3b028b4 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "DELETE /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 204 len: 0 microversion: 2.1 time: 0.117410 Jun 28 03:27:36.647055 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 459/924] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:27:36 2022] DELETE /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:27:36.655439 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d548c299-1036-4c1e-9ffe-cec691dce996 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:36.656050 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d548c299-1036-4c1e-9ffe-cec691dce996 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:36.664968 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d548c299-1036-4c1e-9ffe-cec691dce996 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:36.665402 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d548c299-1036-4c1e-9ffe-cec691dce996 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:36.666145 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d548c299-1036-4c1e-9ffe-cec691dce996 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:36.666593 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d548c299-1036-4c1e-9ffe-cec691dce996 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:36.806979 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d548c299-1036-4c1e-9ffe-cec691dce996 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:36.814721 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d548c299-1036-4c1e-9ffe-cec691dce996 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1675 microversion: 2.1 time: 0.163185 Jun 28 03:27:36.815273 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 466/925] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:36 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:27:37.338541 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b4521d3e-e762-4896-9814-836c432f7e88 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:37.339235 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b4521d3e-e762-4896-9814-836c432f7e88 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:37.346165 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b4521d3e-e762-4896-9814-836c432f7e88 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:37.346606 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b4521d3e-e762-4896-9814-836c432f7e88 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:37.347694 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b4521d3e-e762-4896-9814-836c432f7e88 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:37.348122 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b4521d3e-e762-4896-9814-836c432f7e88 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:37.487256 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b4521d3e-e762-4896-9814-836c432f7e88 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:37.497232 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b4521d3e-e762-4896-9814-836c432f7e88 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1552 microversion: 2.1 time: 0.165556 Jun 28 03:27:37.497801 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 460/926] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:37 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:37.836353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-99ff6115-f18d-4615-9866-01f4d9464ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:37.837347 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-99ff6115-f18d-4615-9866-01f4d9464ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:37.849329 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-99ff6115-f18d-4615-9866-01f4d9464ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:37.850068 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-99ff6115-f18d-4615-9866-01f4d9464ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:37.851317 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-99ff6115-f18d-4615-9866-01f4d9464ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:37.852029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-99ff6115-f18d-4615-9866-01f4d9464ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:37.990486 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-99ff6115-f18d-4615-9866-01f4d9464ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:37.998536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-99ff6115-f18d-4615-9866-01f4d9464ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1675 microversion: 2.1 time: 0.168730 Jun 28 03:27:37.999139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 467/927] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:37 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:38.516381 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7d549483-e864-4921-a046-c76b4ea3549e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:38.517026 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7d549483-e864-4921-a046-c76b4ea3549e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:38.526643 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7d549483-e864-4921-a046-c76b4ea3549e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:38.527107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7d549483-e864-4921-a046-c76b4ea3549e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:38.528210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7d549483-e864-4921-a046-c76b4ea3549e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:38.528788 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7d549483-e864-4921-a046-c76b4ea3549e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:38.668208 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7d549483-e864-4921-a046-c76b4ea3549e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:38.675773 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7d549483-e864-4921-a046-c76b4ea3549e tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1552 microversion: 2.1 time: 0.165066 Jun 28 03:27:38.676363 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 461/928] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:38 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:39.016006 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b78bfac8-997a-49f0-8071-580aac32e5f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:39.016657 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b78bfac8-997a-49f0-8071-580aac32e5f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:39.023763 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b78bfac8-997a-49f0-8071-580aac32e5f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:39.024197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b78bfac8-997a-49f0-8071-580aac32e5f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:39.024973 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b78bfac8-997a-49f0-8071-580aac32e5f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:39.025403 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b78bfac8-997a-49f0-8071-580aac32e5f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:39.316083 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b78bfac8-997a-49f0-8071-580aac32e5f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:39.323900 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b78bfac8-997a-49f0-8071-580aac32e5f8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1675 microversion: 2.1 time: 0.311858 Jun 28 03:27:39.324577 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 468/929] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:39 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1675 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:39.406492 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-2a369367-05fd-4b91-83a2-d3a0bf5da53a req-c962312f-d72b-4ce9-b5ac-6bbf3cba63b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2ecdfcc-81dd-49db-9252-679712c4ec3b", "name": "network-vif-deleted", "tag": "77b5c16f-bdac-49d8-a3cd-4445b397c792"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:27:39.415513 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-2a369367-05fd-4b91-83a2-d3a0bf5da53a req-c962312f-d72b-4ce9-b5ac-6bbf3cba63b8 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:39.415923 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-2a369367-05fd-4b91-83a2-d3a0bf5da53a req-c962312f-d72b-4ce9-b5ac-6bbf3cba63b8 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:39.428009 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-2a369367-05fd-4b91-83a2-d3a0bf5da53a req-c962312f-d72b-4ce9-b5ac-6bbf3cba63b8 service nova] Creating event network-vif-deleted:77b5c16f-bdac-49d8-a3cd-4445b397c792 for instance b2ecdfcc-81dd-49db-9252-679712c4ec3b on hv-cinder-84684 Jun 28 03:27:39.432956 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-2a369367-05fd-4b91-83a2-d3a0bf5da53a req-c962312f-d72b-4ce9-b5ac-6bbf3cba63b8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029899 Jun 28 03:27:39.433618 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 462/930] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:27:39.698178 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f66309b8-98b1-475d-b5e3-2ee08c3056a7 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:39.699191 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f66309b8-98b1-475d-b5e3-2ee08c3056a7 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:39.706034 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f66309b8-98b1-475d-b5e3-2ee08c3056a7 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:39.706478 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f66309b8-98b1-475d-b5e3-2ee08c3056a7 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:39.707244 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f66309b8-98b1-475d-b5e3-2ee08c3056a7 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:39.707668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f66309b8-98b1-475d-b5e3-2ee08c3056a7 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:39.741019 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f66309b8-98b1-475d-b5e3-2ee08c3056a7 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:39.741453 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f66309b8-98b1-475d-b5e3-2ee08c3056a7 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:39.742154 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-f66309b8-98b1-475d-b5e3-2ee08c3056a7 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lazy-loading 'fault' on Instance uuid b2ecdfcc-81dd-49db-9252-679712c4ec3b {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:27:39.784919 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f66309b8-98b1-475d-b5e3-2ee08c3056a7 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f85e7ea701184ef5951da92ecb4cb9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75fde21fa6204de6976409a0d1c4c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:39.792891 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f66309b8-98b1-475d-b5e3-2ee08c3056a7 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 200 len: 1346 microversion: 2.1 time: 0.098915 Jun 28 03:27:39.802954 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 469/931] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:39 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 1346 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:40.344536 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d7cb6b7e-4c0c-4d83-b730-a4d8c095e88b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:40.345280 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d7cb6b7e-4c0c-4d83-b730-a4d8c095e88b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:40.352912 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d7cb6b7e-4c0c-4d83-b730-a4d8c095e88b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:40.353695 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d7cb6b7e-4c0c-4d83-b730-a4d8c095e88b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:40.355457 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d7cb6b7e-4c0c-4d83-b730-a4d8c095e88b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:40.356392 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d7cb6b7e-4c0c-4d83-b730-a4d8c095e88b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:40.392685 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d7cb6b7e-4c0c-4d83-b730-a4d8c095e88b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:40.393243 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d7cb6b7e-4c0c-4d83-b730-a4d8c095e88b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:40.393706 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.objects.instance [None req-d7cb6b7e-4c0c-4d83-b730-a4d8c095e88b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lazy-loading 'fault' on Instance uuid 785c405e-c17b-4e21-b51e-f645dd26f9b9 {{(pid=117681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:27:40.438439 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f01bcd4a-863d-4327-b187-b25d5604653a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:40.439011 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f01bcd4a-863d-4327-b187-b25d5604653a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:40.439166 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d7cb6b7e-4c0c-4d83-b730-a4d8c095e88b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:40.446296 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f01bcd4a-863d-4327-b187-b25d5604653a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:40.446917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d7cb6b7e-4c0c-4d83-b730-a4d8c095e88b tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 200 len: 1328 microversion: 2.1 time: 0.108161 Jun 28 03:27:40.447077 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f01bcd4a-863d-4327-b187-b25d5604653a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:40.447490 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 463/932] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:40 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:40.457131 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f01bcd4a-863d-4327-b187-b25d5604653a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:40.457131 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f01bcd4a-863d-4327-b187-b25d5604653a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:40.475658 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f01bcd4a-863d-4327-b187-b25d5604653a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:27:40.556448 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f01bcd4a-863d-4327-b187-b25d5604653a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "DELETE /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 204 len: 0 microversion: 2.1 time: 0.121566 Jun 28 03:27:40.557431 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 470/933] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:27:40 2022] DELETE /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:27:40.565620 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b0d219f9-bb1c-4b98-bef9-6d0cdf3c2054 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:40.566252 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b0d219f9-bb1c-4b98-bef9-6d0cdf3c2054 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:40.573278 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b0d219f9-bb1c-4b98-bef9-6d0cdf3c2054 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:40.573790 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b0d219f9-bb1c-4b98-bef9-6d0cdf3c2054 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:40.574552 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b0d219f9-bb1c-4b98-bef9-6d0cdf3c2054 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:40.574980 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b0d219f9-bb1c-4b98-bef9-6d0cdf3c2054 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:40.715278 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-b0d219f9-bb1c-4b98-bef9-6d0cdf3c2054 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:40.723538 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b0d219f9-bb1c-4b98-bef9-6d0cdf3c2054 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1579 microversion: 2.1 time: 0.161951 Jun 28 03:27:40.724097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 464/934] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:40 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:40.811473 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6c211fc3-d061-4936-830d-026883519d09 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:40.812139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6c211fc3-d061-4936-830d-026883519d09 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [instance: b2ecdfcc-81dd-49db-9252-679712c4ec3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:40.818422 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6c211fc3-d061-4936-830d-026883519d09 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:40.818864 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6c211fc3-d061-4936-830d-026883519d09 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:40.819622 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6c211fc3-d061-4936-830d-026883519d09 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:40.820041 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6c211fc3-d061-4936-830d-026883519d09 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:40.834294 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-6c211fc3-d061-4936-830d-026883519d09 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] HTTP exception thrown: Instance b2ecdfcc-81dd-49db-9252-679712c4ec3b could not be found. Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6c211fc3-d061-4936-830d-026883519d09 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Request method failure captured: Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b HTTP/1.1 Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunSr7ax0dJpUipCNtNU0T28aArSkS3FSf0jll_B8m-qGMorpFpikS_WRbksNOPerzj6RhCzm-roqfW4TQsOzI9iMIphfx-ldRhC9EfcVS2fC2FlFM6-cksxl2LsZC-MY4dBvRP3yimhTgPyfeLb2FrxnElu_9x_PnNU3vFIK9S7SxGk Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: 75fde21fa6204de6976409a0d1c4c754 Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-TestMinimumBasicScenario-1161928014 Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:27:40.835967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:27:40.837542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_75fde21fa6204de6976409a0d1c4c754", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/75fde21fa6204de6976409a0d1c4c754"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/75fde21fa6204de6976409a0d1c4c754"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/75fde21fa6204de6976409a0d1c4c754"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:27:40.837542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-TestMinimumBasicScenario-1161928014 Jun 28 03:27:40.837542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 75fde21fa6204de6976409a0d1c4c754 Jun 28 03:27:40.837542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1161928014 Jun 28 03:27:40.837542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-TestMinimumBasicScenario-1161928014-project Jun 28 03:27:40.837542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:27:40.837542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:27:40.837542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: f85e7ea701184ef5951da92ecb4cb9ee Jun 28 03:27:40.837542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-TestMinimumBasicScenario-1161928014-project Jun 28 03:27:40.837542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:27:40.837542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance b2ecdfcc-81dd-49db-9252-679712c4ec3b could not be found. Jun 28 03:27:40.837542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': 'b2ecdfcc-81dd-49db-9252-679712c4ec3b'} Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2ecdfcc-81dd-49db-9252-679712c4ec3b could not be found. Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:27:40.838305 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2ecdfcc-81dd-49db-9252-679712c4ec3b could not be found. Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2ecdfcc-81dd-49db-9252-679712c4ec3b could not be found. Jun 28 03:27:40.839902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:40.841866 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6c211fc3-d061-4936-830d-026883519d09 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Returning 404 to user: Instance b2ecdfcc-81dd-49db-9252-679712c4ec3b could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:27:40.841866 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6c211fc3-d061-4936-830d-026883519d09 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b" status: 404 len: 111 microversion: 2.1 time: 0.030505 Jun 28 03:27:40.841866 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 471/935] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:40 2022] GET /compute/v2.1/servers/b2ecdfcc-81dd-49db-9252-679712c4ec3b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:27:40.846513 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-716d50ef-df92-4902-8f68-8ba86d779b64 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] Calling method '.version_select at 0x7f53f1a771f0>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:40.850144 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR oslo.messaging._drivers.impl_rabbit [None req-716d50ef-df92-4902-8f68-8ba86d779b64 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [7abfcc25-68e4-4887-b965-5b65bd5b71f1] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 28 03:27:41.452824 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-27a17f8f-e315-4615-acf3-a8f826784723 req-1c46a3a9-720a-4f6c-88e4-d6079cad3ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785c405e-c17b-4e21-b51e-f645dd26f9b9", "name": "network-vif-deleted", "tag": "b7f197d8-65db-4b70-b5fc-1416f37de7ba"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:27:41.461844 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-27a17f8f-e315-4615-acf3-a8f826784723 req-1c46a3a9-720a-4f6c-88e4-d6079cad3ff2 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:41.462277 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-27a17f8f-e315-4615-acf3-a8f826784723 req-1c46a3a9-720a-4f6c-88e4-d6079cad3ff2 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:41.474160 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-27a17f8f-e315-4615-acf3-a8f826784723 req-1c46a3a9-720a-4f6c-88e4-d6079cad3ff2 service nova] Creating event network-vif-deleted:b7f197d8-65db-4b70-b5fc-1416f37de7ba for instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 on hv-cinder-84684 Jun 28 03:27:41.479247 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-27a17f8f-e315-4615-acf3-a8f826784723 req-1c46a3a9-720a-4f6c-88e4-d6079cad3ff2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029966 Jun 28 03:27:41.480096 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 472/936] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:27:41.487407 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6ef78c78-38f2-4cb6-9b0c-85d7a5c8e48d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:41.488388 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6ef78c78-38f2-4cb6-9b0c-85d7a5c8e48d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:41.498149 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6ef78c78-38f2-4cb6-9b0c-85d7a5c8e48d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:41.498684 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6ef78c78-38f2-4cb6-9b0c-85d7a5c8e48d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:41.499765 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6ef78c78-38f2-4cb6-9b0c-85d7a5c8e48d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:41.500399 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6ef78c78-38f2-4cb6-9b0c-85d7a5c8e48d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:41.517260 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-6ef78c78-38f2-4cb6-9b0c-85d7a5c8e48d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] HTTP exception thrown: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6ef78c78-38f2-4cb6-9b0c-85d7a5c8e48d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Request method failure captured: Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 HTTP/1.1 Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunRqajM1putZtXFgXYsipiMkAdBHXaim_McJ8gBdTAqXsSzY9tJpOaQDleBkTUWXffmw3d2P93qUarAhffuhW1xy2iDjLeBboCba8hgaVQ-MahD4QEsKC2lFJ3Xeg8DowIuSn83PikjKqF6Csp6S5dxmmY9RgJsdp8SLlue0VatSAGg Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: d4fae3b890884f28a70d0ccc855d5365 Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:27:41.518868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:27:41.520348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d4fae3b890884f28a70d0ccc855d5365", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:27:41.520348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:27:41.520348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: d4fae3b890884f28a70d0ccc855d5365 Jun 28 03:27:41.520348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:27:41.520348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeTestJSON-1617728001-project Jun 28 03:27:41.520348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:27:41.520348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:27:41.520348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 5efee06a99e04a349f314b7c6c44837b Jun 28 03:27:41.520348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeTestJSON-1617728001-project Jun 28 03:27:41.520348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:27:41.520348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:27:41.520348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '785c405e-c17b-4e21-b51e-f645dd26f9b9'} Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:27:41.521139 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:27:41.522596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:41.523885 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6ef78c78-38f2-4cb6-9b0c-85d7a5c8e48d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Returning 404 to user: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:27:41.523885 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6ef78c78-38f2-4cb6-9b0c-85d7a5c8e48d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 404 len: 111 microversion: 2.1 time: 0.038281 Jun 28 03:27:41.523885 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 473/937] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:41 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:27:41.529777 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7056311b-337f-4f68-ac00-f0c6780cf40a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '.version_select at 0x7f53f1adf940>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:41.551605 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7056311b-337f-4f68-ac00-f0c6780cf40a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221186413" status: 202 len: 0 microversion: 2.1 time: 0.026132 Jun 28 03:27:41.552185 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 474/938] 10.222.0.44 () {58 vars in 1220 bytes} [Tue Jun 28 03:27:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1221186413 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 03:27:41.741418 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-090fae2e-6871-4fd5-bc87-f01446d0a4d8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:41.741662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-090fae2e-6871-4fd5-bc87-f01446d0a4d8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:41.748652 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-090fae2e-6871-4fd5-bc87-f01446d0a4d8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:41.749100 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-090fae2e-6871-4fd5-bc87-f01446d0a4d8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:41.749869 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-090fae2e-6871-4fd5-bc87-f01446d0a4d8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:41.750274 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-090fae2e-6871-4fd5-bc87-f01446d0a4d8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:41.859035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO oslo.messaging._drivers.impl_rabbit [None req-716d50ef-df92-4902-8f68-8ba86d779b64 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] [7abfcc25-68e4-4887-b965-5b65bd5b71f1] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 49392. Jun 28 03:27:41.880573 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-716d50ef-df92-4902-8f68-8ba86d779b64 tempest-TestMinimumBasicScenario-1161928014 tempest-TestMinimumBasicScenario-1161928014-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-710416305" status: 202 len: 0 microversion: 2.1 time: 1.037791 Jun 28 03:27:41.881153 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 465/939] 10.222.0.44 () {58 vars in 1268 bytes} [Tue Jun 28 03:27:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-710416305 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:27:42.000067 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-090fae2e-6871-4fd5-bc87-f01446d0a4d8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:42.008903 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-090fae2e-6871-4fd5-bc87-f01446d0a4d8 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1579 microversion: 2.1 time: 0.271637 Jun 28 03:27:42.009473 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 475/940] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:41 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1579 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:27:42.290788 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-05c2fa02-b88e-4565-a94a-cb01f57ac029 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Action: 'create', calling method: .version_select at 0x7f53f1ac0310>, body: {"keypair": {"name": "tempest-keypair-1374566449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwG1+lOsZv6i2uP8an48K4/J8XLHCnMnbPMxDYKu5R5SiMbm2lPNkvEDVKJzVMJzIh0dBh6fYrmM0HX43nmx8VrQHNSIleaRFr4iDwpUySnsaEhq8beUUSBmxSh0EBzIg=="}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:27:42.305808 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-05c2fa02-b88e-4565-a94a-cb01f57ac029 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Getting quotas for project d4fae3b890884f28a70d0ccc855d5365. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:27:42.310219 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-05c2fa02-b88e-4565-a94a-cb01f57ac029 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Getting quotas for user 5efee06a99e04a349f314b7c6c44837b and project d4fae3b890884f28a70d0ccc855d5365. Resources: {'key_pairs'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:27:42.337189 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-05c2fa02-b88e-4565-a94a-cb01f57ac029 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050212 Jun 28 03:27:42.337947 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 466/941] 10.222.0.44 () {60 vars in 1158 bytes} [Tue Jun 28 03:27:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:27:43.028257 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-60d78803-4488-477e-8bc1-530b2738c1cf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:43.041001 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-60d78803-4488-477e-8bc1-530b2738c1cf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:43.047700 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-60d78803-4488-477e-8bc1-530b2738c1cf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:43.053678 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-60d78803-4488-477e-8bc1-530b2738c1cf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:43.057393 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-60d78803-4488-477e-8bc1-530b2738c1cf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:43.060433 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-60d78803-4488-477e-8bc1-530b2738c1cf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:43.200136 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-60d78803-4488-477e-8bc1-530b2738c1cf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:43.213990 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-60d78803-4488-477e-8bc1-530b2738c1cf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 200 len: 1511 microversion: 2.1 time: 0.191036 Jun 28 03:27:43.215163 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 476/942] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:43 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:43.506586 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-a6adc851-2b97-493c-8753-b1eac7a228a1 req-110b3d51-56a0-4f59-ad3b-eb03aa4cd8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e32105-0f00-4bec-be78-59f9383e3992", "name": "network-vif-deleted", "tag": "8216d3f8-6222-4089-bdc6-74085387c8a5"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:27:43.519778 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-a6adc851-2b97-493c-8753-b1eac7a228a1 req-110b3d51-56a0-4f59-ad3b-eb03aa4cd8ae service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:43.520484 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-a6adc851-2b97-493c-8753-b1eac7a228a1 req-110b3d51-56a0-4f59-ad3b-eb03aa4cd8ae service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:43.548132 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-a6adc851-2b97-493c-8753-b1eac7a228a1 req-110b3d51-56a0-4f59-ad3b-eb03aa4cd8ae service nova] Creating event network-vif-deleted:8216d3f8-6222-4089-bdc6-74085387c8a5 for instance 10e32105-0f00-4bec-be78-59f9383e3992 on hv-cinder-84684 Jun 28 03:27:43.559222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-a6adc851-2b97-493c-8753-b1eac7a228a1 req-110b3d51-56a0-4f59-ad3b-eb03aa4cd8ae service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059105 Jun 28 03:27:43.560230 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 467/943] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:27:44.233778 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a9f4ddbf-0fe7-482b-ad1c-eabd0bb4138f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:44.235020 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a9f4ddbf-0fe7-482b-ad1c-eabd0bb4138f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:44.242930 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a9f4ddbf-0fe7-482b-ad1c-eabd0bb4138f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:44.243721 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a9f4ddbf-0fe7-482b-ad1c-eabd0bb4138f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:44.245402 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a9f4ddbf-0fe7-482b-ad1c-eabd0bb4138f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:44.246306 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a9f4ddbf-0fe7-482b-ad1c-eabd0bb4138f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:44.284402 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-a9f4ddbf-0fe7-482b-ad1c-eabd0bb4138f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] HTTP exception thrown: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a9f4ddbf-0fe7-482b-ad1c-eabd0bb4138f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Request method failure captured: Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 HTTP/1.1 Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunR1ij-HscsMZORDg-GrmoWUBiLr0yD0AdUjWzAWnAq9SpyPmJsre7q2VCDZXHY9vvgjwXJUwS5EJiAe8z4TqqlhlsLLeyy1-qhSQiApdrJc9tFJPIZdDsOaRT43YxG6_6Qznrhw0O3NasO6aDRCKwhWV29P9rfZTOw1Pn8cgFfO3bA Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: cc2d6ae6d1f74852b9b51d970d19d0df Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-TestVolumeBootPattern-261448631 Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:27:44.286197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:27:44.287739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cc2d6ae6d1f74852b9b51d970d19d0df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:27:44.287739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-TestVolumeBootPattern-261448631 Jun 28 03:27:44.287739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: cc2d6ae6d1f74852b9b51d970d19d0df Jun 28 03:27:44.287739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-TestVolumeBootPattern-261448631 Jun 28 03:27:44.287739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-TestVolumeBootPattern-261448631-project Jun 28 03:27:44.287739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:27:44.287739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:27:44.287739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 3480ec26f30343e58a5e7b5329cb2cce Jun 28 03:27:44.287739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-TestVolumeBootPattern-261448631-project Jun 28 03:27:44.287739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:27:44.287739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:27:44.287739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '10e32105-0f00-4bec-be78-59f9383e3992'} Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:27:44.288674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:27:44.290044 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:27:44.293560 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a9f4ddbf-0fe7-482b-ad1c-eabd0bb4138f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Returning 404 to user: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:27:44.294820 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a9f4ddbf-0fe7-482b-ad1c-eabd0bb4138f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 404 len: 111 microversion: 2.1 time: 0.065326 Jun 28 03:27:44.295562 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 477/944] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:44 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:27:44.517528 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-69202240", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1536016975", "security_groups": [{"name": "tempest-secgroup-smoke-1125387860"}], "block_device_mapping_v2": [{"uuid": "d135ac5b-1d3d-4232-8066-7666c8fec78b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa3b8415-5dcf-451a-a58a-63fa23e098ab"}]}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:27:44.518616 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-562852042", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4a0b7c7d-030f-4368-b16f-203c59ecfcfc"}], "security_groups": [{"name": "tempest-securitygroup--1568261961"}], "key_name": "tempest-keypair-1374566449", "user_data": "}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:27:45.018480 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] validate_networks() for [('fa3b8415-5dcf-451a-a58a-63fa23e098ab', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:27:45.023418 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.network.neutron [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] validate_networks() for [('4a0b7c7d-030f-4368-b16f-203c59ecfcfc', None, None, None, None, None)] {{(pid=117681) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:27:45.932810 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Flavor limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:27:45.933363 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Image limits 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:27:45.933697 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Flavor pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:27:45.934131 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Image pref 0:0:0 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:27:45.934534 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.virt.hardware [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117681) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:27:45.944361 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:45.944807 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:45.945595 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:45.946026 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:45.963921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Getting quotas for project d4fae3b890884f28a70d0ccc855d5365. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:27:45.968436 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.quota [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Getting quotas for user 5efee06a99e04a349f314b7c6c44837b and project d4fae3b890884f28a70d0ccc855d5365. Resources: {'instances', 'ram', 'cores'} {{(pid=117681) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:27:45.980441 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Going to run 1 instances... {{(pid=117681) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:27:45.982823 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117681) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:27:46.010877 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:27:46.012099 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:27:46.012863 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:27:46.013215 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:27:46.013823 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:27:46.023234 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:46.023685 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:46.024526 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:46.024963 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:46.034237 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a43d86a5-9b02-442b-9356-481a8134c769 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.526487 Jun 28 03:27:46.035947 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 468/945] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:27:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:27:46.042773 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Getting quotas for project cc2d6ae6d1f74852b9b51d970d19d0df. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:27:46.047790 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Getting quotas for user 3480ec26f30343e58a5e7b5329cb2cce and project cc2d6ae6d1f74852b9b51d970d19d0df. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:27:46.053156 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-8a4de205-b39c-45f9-957b-5bc531c2a2c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:46.053381 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-8a4de205-b39c-45f9-957b-5bc531c2a2c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:46.117617 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-8a4de205-b39c-45f9-957b-5bc531c2a2c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:46.124853 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-8a4de205-b39c-45f9-957b-5bc531c2a2c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1237 microversion: 2.1 time: 0.083149 Jun 28 03:27:46.126367 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 469/946] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:46 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:46.159250 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:27:46.165115 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d135ac5b-1d3d-4232-8066-7666c8fec78b',volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:27:46.328992 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d931280c-9633-4771-b876-b1b02228a324 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.817518 Jun 28 03:27:46.332216 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 478/947] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:27:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 28 03:27:46.340134 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a9479c9e-7125-4739-8a73-71eb98f6cbf2 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:46.340771 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a9479c9e-7125-4739-8a73-71eb98f6cbf2 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:46.417358 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a9479c9e-7125-4739-8a73-71eb98f6cbf2 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:46.426136 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a9479c9e-7125-4739-8a73-71eb98f6cbf2 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1093 microversion: 2.1 time: 0.088786 Jun 28 03:27:46.430602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 470/948] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:46 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1093 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:47.142686 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a58fd70e-4a15-4f2d-b365-65b7a43f23de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:47.143505 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a58fd70e-4a15-4f2d-b365-65b7a43f23de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:47.152005 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a58fd70e-4a15-4f2d-b365-65b7a43f23de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:47.153228 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a58fd70e-4a15-4f2d-b365-65b7a43f23de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:47.154045 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a58fd70e-4a15-4f2d-b365-65b7a43f23de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:47.154482 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a58fd70e-4a15-4f2d-b365-65b7a43f23de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:47.158988 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:27:47.237527 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a58fd70e-4a15-4f2d-b365-65b7a43f23de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:47.248525 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a58fd70e-4a15-4f2d-b365-65b7a43f23de tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1289 microversion: 2.1 time: 0.110236 Jun 28 03:27:47.249002 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 479/949] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:47 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:47.448208 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6fe5dffd-326c-48da-947a-ce518359746b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:47.449023 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6fe5dffd-326c-48da-947a-ce518359746b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:47.456038 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fe5dffd-326c-48da-947a-ce518359746b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:47.456555 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fe5dffd-326c-48da-947a-ce518359746b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:47.457308 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fe5dffd-326c-48da-947a-ce518359746b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:47.457739 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6fe5dffd-326c-48da-947a-ce518359746b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:47.526763 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6fe5dffd-326c-48da-947a-ce518359746b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:47.535028 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6fe5dffd-326c-48da-947a-ce518359746b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1191 microversion: 2.1 time: 0.090763 Jun 28 03:27:47.535648 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 471/950] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:47 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:48.266689 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9e2a6400-802b-4c74-bc11-4f882b1e6097 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:48.267349 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9e2a6400-802b-4c74-bc11-4f882b1e6097 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:48.275347 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9e2a6400-802b-4c74-bc11-4f882b1e6097 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:48.275829 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9e2a6400-802b-4c74-bc11-4f882b1e6097 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:48.276756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9e2a6400-802b-4c74-bc11-4f882b1e6097 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:48.277195 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9e2a6400-802b-4c74-bc11-4f882b1e6097 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:48.350958 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9e2a6400-802b-4c74-bc11-4f882b1e6097 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:48.359785 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9e2a6400-802b-4c74-bc11-4f882b1e6097 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1295 microversion: 2.1 time: 0.097092 Jun 28 03:27:48.364205 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 480/951] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:48 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1295 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:48.552505 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-9212c13e-9374-48c9-b1ef-5c0ca4af4771 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:48.553647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-9212c13e-9374-48c9-b1ef-5c0ca4af4771 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:48.562149 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9212c13e-9374-48c9-b1ef-5c0ca4af4771 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:48.562940 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9212c13e-9374-48c9-b1ef-5c0ca4af4771 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:48.564127 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9212c13e-9374-48c9-b1ef-5c0ca4af4771 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:48.564663 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-9212c13e-9374-48c9-b1ef-5c0ca4af4771 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:48.654581 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-9212c13e-9374-48c9-b1ef-5c0ca4af4771 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:48.676423 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-9212c13e-9374-48c9-b1ef-5c0ca4af4771 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1209 microversion: 2.1 time: 0.127253 Jun 28 03:27:48.686384 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 472/952] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:48 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1209 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:49.377435 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-38ece7dd-640f-48ba-9111-b4f439b2097d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:49.378713 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-38ece7dd-640f-48ba-9111-b4f439b2097d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:49.385266 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-38ece7dd-640f-48ba-9111-b4f439b2097d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:49.385962 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-38ece7dd-640f-48ba-9111-b4f439b2097d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:49.386929 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-38ece7dd-640f-48ba-9111-b4f439b2097d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:49.387520 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-38ece7dd-640f-48ba-9111-b4f439b2097d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:49.702923 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4cbc15c0-d5ca-4876-98d6-f2d3e3819fbb tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:49.704098 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4cbc15c0-d5ca-4876-98d6-f2d3e3819fbb tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:49.705545 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-38ece7dd-640f-48ba-9111-b4f439b2097d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:49.712198 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4cbc15c0-d5ca-4876-98d6-f2d3e3819fbb tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:49.712629 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4cbc15c0-d5ca-4876-98d6-f2d3e3819fbb tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:49.714164 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4cbc15c0-d5ca-4876-98d6-f2d3e3819fbb tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:49.714863 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4cbc15c0-d5ca-4876-98d6-f2d3e3819fbb tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:49.717818 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-38ece7dd-640f-48ba-9111-b4f439b2097d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1363 microversion: 2.1 time: 0.344132 Jun 28 03:27:49.720520 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 481/953] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:49 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:49.749929 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:27:49.980930 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4cbc15c0-d5ca-4876-98d6-f2d3e3819fbb tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:49.991177 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4cbc15c0-d5ca-4876-98d6-f2d3e3819fbb tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1265 microversion: 2.1 time: 0.291926 Jun 28 03:27:49.996666 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 473/954] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:49 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:50.069995 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-2073ecfd-91a7-4c3d-8252-144b31f7d24f req-a1c45559-6832-44ed-ac27-5585ba9ebd5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b9432b-54cd-48ff-b183-6a5eac7f0a3b", "tag": "db32f36e-d5cf-4d1a-bf73-975e7af752f3"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:27:50.098903 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-2073ecfd-91a7-4c3d-8252-144b31f7d24f req-a1c45559-6832-44ed-ac27-5585ba9ebd5d service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:50.099350 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-2073ecfd-91a7-4c3d-8252-144b31f7d24f req-a1c45559-6832-44ed-ac27-5585ba9ebd5d service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:50.149131 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-2073ecfd-91a7-4c3d-8252-144b31f7d24f req-a1c45559-6832-44ed-ac27-5585ba9ebd5d service nova] Creating event network-changed:db32f36e-d5cf-4d1a-bf73-975e7af752f3 for instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b on hv-cinder-84684 Jun 28 03:27:50.158733 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-2073ecfd-91a7-4c3d-8252-144b31f7d24f req-a1c45559-6832-44ed-ac27-5585ba9ebd5d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092450 Jun 28 03:27:50.159748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 482/955] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:27:50.737641 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-98f802a5-e73e-487f-be0d-014d4b63e6ec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:50.738922 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-98f802a5-e73e-487f-be0d-014d4b63e6ec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:50.756232 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-98f802a5-e73e-487f-be0d-014d4b63e6ec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:50.757011 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-98f802a5-e73e-487f-be0d-014d4b63e6ec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:50.758078 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-98f802a5-e73e-487f-be0d-014d4b63e6ec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:50.759467 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-98f802a5-e73e-487f-be0d-014d4b63e6ec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:50.921138 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-98f802a5-e73e-487f-be0d-014d4b63e6ec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:50.929504 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-98f802a5-e73e-487f-be0d-014d4b63e6ec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1363 microversion: 2.1 time: 0.195894 Jun 28 03:27:50.930250 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 474/956] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:50 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:27:51.009311 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e31d940a-2029-4846-b3de-ffb6ed4ca5c4 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:51.009947 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e31d940a-2029-4846-b3de-ffb6ed4ca5c4 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:51.017818 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e31d940a-2029-4846-b3de-ffb6ed4ca5c4 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:51.018692 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e31d940a-2029-4846-b3de-ffb6ed4ca5c4 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:51.019474 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e31d940a-2029-4846-b3de-ffb6ed4ca5c4 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:51.020171 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e31d940a-2029-4846-b3de-ffb6ed4ca5c4 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:51.192998 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e31d940a-2029-4846-b3de-ffb6ed4ca5c4 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:51.202230 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e31d940a-2029-4846-b3de-ffb6ed4ca5c4 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1265 microversion: 2.1 time: 0.197317 Jun 28 03:27:51.202882 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 483/957] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:51 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:51.947658 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-fae5d70b-3a9f-43b9-a2fd-fb321472f471 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:51.948282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-fae5d70b-3a9f-43b9-a2fd-fb321472f471 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:51.954979 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fae5d70b-3a9f-43b9-a2fd-fb321472f471 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:51.955425 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fae5d70b-3a9f-43b9-a2fd-fb321472f471 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:51.956220 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fae5d70b-3a9f-43b9-a2fd-fb321472f471 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:51.956664 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-fae5d70b-3a9f-43b9-a2fd-fb321472f471 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:52.093153 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-fae5d70b-3a9f-43b9-a2fd-fb321472f471 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:52.101442 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-fae5d70b-3a9f-43b9-a2fd-fb321472f471 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1363 microversion: 2.1 time: 0.157666 Jun 28 03:27:52.111122 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 475/958] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:51 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:52.221012 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-21175aff-9045-439a-8e8c-17025abf8bd6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:52.221682 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-21175aff-9045-439a-8e8c-17025abf8bd6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:52.222840 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-dfd2dff4-8e02-48e8-ac87-162b7350aa66 req-300cde4e-6b6f-4c76-a026-cc88448ac02c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3d15481-1950-4451-a558-876c37530561", "tag": "3e2db863-652b-415d-8de9-73dd5344769a"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:27:52.229536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-21175aff-9045-439a-8e8c-17025abf8bd6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:52.230207 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-21175aff-9045-439a-8e8c-17025abf8bd6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:52.231151 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-21175aff-9045-439a-8e8c-17025abf8bd6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:52.232064 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-dfd2dff4-8e02-48e8-ac87-162b7350aa66 req-300cde4e-6b6f-4c76-a026-cc88448ac02c service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:52.232481 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-21175aff-9045-439a-8e8c-17025abf8bd6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:52.232657 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-dfd2dff4-8e02-48e8-ac87-162b7350aa66 req-300cde4e-6b6f-4c76-a026-cc88448ac02c service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:52.243966 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-dfd2dff4-8e02-48e8-ac87-162b7350aa66 req-300cde4e-6b6f-4c76-a026-cc88448ac02c service nova] Creating event network-changed:3e2db863-652b-415d-8de9-73dd5344769a for instance b3d15481-1950-4451-a558-876c37530561 on hv-cinder-84684 Jun 28 03:27:52.250225 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-dfd2dff4-8e02-48e8-ac87-162b7350aa66 req-300cde4e-6b6f-4c76-a026-cc88448ac02c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033491 Jun 28 03:27:52.251337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 476/959] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:27:52.432554 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-21175aff-9045-439a-8e8c-17025abf8bd6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:52.440683 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-21175aff-9045-439a-8e8c-17025abf8bd6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1265 microversion: 2.1 time: 0.225233 Jun 28 03:27:52.441262 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 484/960] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:52 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:53.119856 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3315892a-f59c-47f8-863d-4009cebdf736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:53.120573 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-3315892a-f59c-47f8-863d-4009cebdf736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:53.127041 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3315892a-f59c-47f8-863d-4009cebdf736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:53.127489 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3315892a-f59c-47f8-863d-4009cebdf736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:53.128278 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3315892a-f59c-47f8-863d-4009cebdf736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:53.128712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3315892a-f59c-47f8-863d-4009cebdf736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:53.267230 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-3315892a-f59c-47f8-863d-4009cebdf736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:53.275592 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3315892a-f59c-47f8-863d-4009cebdf736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1363 microversion: 2.1 time: 0.160471 Jun 28 03:27:53.285661 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 477/961] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:53 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:53.460074 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-991f0c0d-13f5-4617-ad85-373cd543fc92 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:53.460715 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-991f0c0d-13f5-4617-ad85-373cd543fc92 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:53.471008 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-991f0c0d-13f5-4617-ad85-373cd543fc92 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:53.471632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-991f0c0d-13f5-4617-ad85-373cd543fc92 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:53.473011 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-991f0c0d-13f5-4617-ad85-373cd543fc92 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:53.473613 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-991f0c0d-13f5-4617-ad85-373cd543fc92 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:53.615581 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-991f0c0d-13f5-4617-ad85-373cd543fc92 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:53.623368 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-991f0c0d-13f5-4617-ad85-373cd543fc92 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1265 microversion: 2.1 time: 0.169033 Jun 28 03:27:53.623933 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 485/962] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:53 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:54.295251 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-03114b60-3043-4407-b81d-4c2c1e27d81d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:54.295996 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-03114b60-3043-4407-b81d-4c2c1e27d81d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:54.302989 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-03114b60-3043-4407-b81d-4c2c1e27d81d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:54.303431 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-03114b60-3043-4407-b81d-4c2c1e27d81d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:54.304178 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-03114b60-3043-4407-b81d-4c2c1e27d81d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:54.304639 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-03114b60-3043-4407-b81d-4c2c1e27d81d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:54.445339 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-03114b60-3043-4407-b81d-4c2c1e27d81d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:54.453455 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-03114b60-3043-4407-b81d-4c2c1e27d81d tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1363 microversion: 2.1 time: 0.162477 Jun 28 03:27:54.454028 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 478/963] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:54 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:54.644871 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a7ae75ca-dd61-4bf8-8c8d-988c9a29a90d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:54.645974 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a7ae75ca-dd61-4bf8-8c8d-988c9a29a90d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:54.655394 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a7ae75ca-dd61-4bf8-8c8d-988c9a29a90d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:54.655847 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a7ae75ca-dd61-4bf8-8c8d-988c9a29a90d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:54.656650 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a7ae75ca-dd61-4bf8-8c8d-988c9a29a90d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:54.657080 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a7ae75ca-dd61-4bf8-8c8d-988c9a29a90d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:54.802663 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a7ae75ca-dd61-4bf8-8c8d-988c9a29a90d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:54.810882 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a7ae75ca-dd61-4bf8-8c8d-988c9a29a90d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1265 microversion: 2.1 time: 0.172720 Jun 28 03:27:54.811479 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 486/964] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:54 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:55.357121 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-651e5d15-a70f-4952-a757-2f5691117074 req-bb95cf40-2e36-4059-be1f-3fe3d100780a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b9432b-54cd-48ff-b183-6a5eac7f0a3b", "name": "network-vif-plugged", "status": "completed", "tag": "db32f36e-d5cf-4d1a-bf73-975e7af752f3"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:27:55.365706 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-651e5d15-a70f-4952-a757-2f5691117074 req-bb95cf40-2e36-4059-be1f-3fe3d100780a service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:55.366139 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-651e5d15-a70f-4952-a757-2f5691117074 req-bb95cf40-2e36-4059-be1f-3fe3d100780a service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:55.380088 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-651e5d15-a70f-4952-a757-2f5691117074 req-bb95cf40-2e36-4059-be1f-3fe3d100780a service nova] Creating event network-vif-plugged:db32f36e-d5cf-4d1a-bf73-975e7af752f3 for instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b on hv-cinder-84684 Jun 28 03:27:55.385054 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-651e5d15-a70f-4952-a757-2f5691117074 req-bb95cf40-2e36-4059-be1f-3fe3d100780a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031870 Jun 28 03:27:55.385672 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 479/965] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:27:55.470616 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e47d8e76-c9ef-4cb3-91fa-7b4e6aced985 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:55.471533 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e47d8e76-c9ef-4cb3-91fa-7b4e6aced985 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:55.478438 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e47d8e76-c9ef-4cb3-91fa-7b4e6aced985 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:55.478875 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e47d8e76-c9ef-4cb3-91fa-7b4e6aced985 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:55.479645 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e47d8e76-c9ef-4cb3-91fa-7b4e6aced985 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:55.480082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e47d8e76-c9ef-4cb3-91fa-7b4e6aced985 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:55.614359 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e47d8e76-c9ef-4cb3-91fa-7b4e6aced985 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:55.622630 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e47d8e76-c9ef-4cb3-91fa-7b4e6aced985 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1363 microversion: 2.1 time: 0.155990 Jun 28 03:27:55.623294 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 487/966] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:55 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:55.837010 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-55ddd942-277c-4f4f-8ca0-56522efc3f72 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:55.838019 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-55ddd942-277c-4f4f-8ca0-56522efc3f72 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:55.842908 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:27:55.849605 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-55ddd942-277c-4f4f-8ca0-56522efc3f72 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:55.850331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-55ddd942-277c-4f4f-8ca0-56522efc3f72 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:55.851566 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-55ddd942-277c-4f4f-8ca0-56522efc3f72 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:55.852309 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-55ddd942-277c-4f4f-8ca0-56522efc3f72 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:55.952932 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:27:55.998937 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-55ddd942-277c-4f4f-8ca0-56522efc3f72 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:56.009695 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-55ddd942-277c-4f4f-8ca0-56522efc3f72 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1265 microversion: 2.1 time: 0.183212 Jun 28 03:27:56.010490 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 480/967] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:55 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:56.641608 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b71eb8ee-acda-4179-ae36-fd4d3d00d6d8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:56.642206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b71eb8ee-acda-4179-ae36-fd4d3d00d6d8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:56.644686 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:27:56.645355 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:27:56.652301 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b71eb8ee-acda-4179-ae36-fd4d3d00d6d8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:56.652748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b71eb8ee-acda-4179-ae36-fd4d3d00d6d8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:56.653545 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b71eb8ee-acda-4179-ae36-fd4d3d00d6d8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:56.653988 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b71eb8ee-acda-4179-ae36-fd4d3d00d6d8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:56.786634 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b71eb8ee-acda-4179-ae36-fd4d3d00d6d8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:56.794804 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b71eb8ee-acda-4179-ae36-fd4d3d00d6d8 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1363 microversion: 2.1 time: 0.157630 Jun 28 03:27:56.795413 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 488/968] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:56 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:57.028921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a84f5c1a-39ee-4eee-b577-ea2c2a2fcc27 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:57.029875 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a84f5c1a-39ee-4eee-b577-ea2c2a2fcc27 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:57.032263 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=14 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:27:57.038044 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a84f5c1a-39ee-4eee-b577-ea2c2a2fcc27 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:57.038480 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a84f5c1a-39ee-4eee-b577-ea2c2a2fcc27 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:57.039594 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a84f5c1a-39ee-4eee-b577-ea2c2a2fcc27 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:57.040045 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a84f5c1a-39ee-4eee-b577-ea2c2a2fcc27 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:57.175181 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a84f5c1a-39ee-4eee-b577-ea2c2a2fcc27 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:57.184029 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a84f5c1a-39ee-4eee-b577-ea2c2a2fcc27 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1265 microversion: 2.1 time: 0.160485 Jun 28 03:27:57.184623 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 481/969] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:57 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:57.813155 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-11f74660-e17b-40b2-a533-50008c40f736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:57.813757 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-11f74660-e17b-40b2-a533-50008c40f736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:57.821291 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-11f74660-e17b-40b2-a533-50008c40f736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:57.821778 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-11f74660-e17b-40b2-a533-50008c40f736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:57.822585 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-11f74660-e17b-40b2-a533-50008c40f736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:57.823037 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-11f74660-e17b-40b2-a533-50008c40f736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:57.960565 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-11f74660-e17b-40b2-a533-50008c40f736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:57.968328 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-11f74660-e17b-40b2-a533-50008c40f736 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1550 microversion: 2.1 time: 0.159520 Jun 28 03:27:57.968868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 489/970] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:57 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:57.985179 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e290c4d4-22c9-4745-8b40-e7ee10d540ce tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:57.985658 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e290c4d4-22c9-4745-8b40-e7ee10d540ce tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:57.992283 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e290c4d4-22c9-4745-8b40-e7ee10d540ce tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:57.992725 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e290c4d4-22c9-4745-8b40-e7ee10d540ce tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:57.993477 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e290c4d4-22c9-4745-8b40-e7ee10d540ce tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:57.993905 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e290c4d4-22c9-4745-8b40-e7ee10d540ce tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:58.081503 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e290c4d4-22c9-4745-8b40-e7ee10d540ce tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099687 Jun 28 03:27:58.082336 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 482/971] 10.222.0.44 () {58 vars in 1274 bytes} [Tue Jun 28 03:27:57 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:27:58.201500 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7e054098-b52d-4b61-8fe0-bff0d79ccfbd tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:58.202074 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7e054098-b52d-4b61-8fe0-bff0d79ccfbd tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:58.208525 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7e054098-b52d-4b61-8fe0-bff0d79ccfbd tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:58.208957 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7e054098-b52d-4b61-8fe0-bff0d79ccfbd tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:58.209724 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7e054098-b52d-4b61-8fe0-bff0d79ccfbd tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:58.210161 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7e054098-b52d-4b61-8fe0-bff0d79ccfbd tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:58.349818 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7e054098-b52d-4b61-8fe0-bff0d79ccfbd tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:58.357776 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7e054098-b52d-4b61-8fe0-bff0d79ccfbd tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1265 microversion: 2.1 time: 0.160347 Jun 28 03:27:58.358578 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 490/972] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:58 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:27:59.020758 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-9903a2e8-c8f3-4c43-9b4d-864f71b6efa4 req-bbf37a62-5be9-46cf-9381-4fabb08202b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b9432b-54cd-48ff-b183-6a5eac7f0a3b", "tag": "db32f36e-d5cf-4d1a-bf73-975e7af752f3"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:27:59.029097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-9903a2e8-c8f3-4c43-9b4d-864f71b6efa4 req-bbf37a62-5be9-46cf-9381-4fabb08202b1 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:59.029540 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-9903a2e8-c8f3-4c43-9b4d-864f71b6efa4 req-bbf37a62-5be9-46cf-9381-4fabb08202b1 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:59.041205 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-9903a2e8-c8f3-4c43-9b4d-864f71b6efa4 req-bbf37a62-5be9-46cf-9381-4fabb08202b1 service nova] Creating event network-changed:db32f36e-d5cf-4d1a-bf73-975e7af752f3 for instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b on hv-cinder-84684 Jun 28 03:27:59.046261 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-9903a2e8-c8f3-4c43-9b4d-864f71b6efa4 req-bbf37a62-5be9-46cf-9381-4fabb08202b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029266 Jun 28 03:27:59.046892 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 483/973] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:27:59.375376 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-69b83851-b548-46b5-92bf-7be7b18ca546 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:27:59.375951 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-69b83851-b548-46b5-92bf-7be7b18ca546 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:27:59.382427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-69b83851-b548-46b5-92bf-7be7b18ca546 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:59.383297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-69b83851-b548-46b5-92bf-7be7b18ca546 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:59.383627 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-69b83851-b548-46b5-92bf-7be7b18ca546 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:27:59.384192 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-69b83851-b548-46b5-92bf-7be7b18ca546 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:27:59.541319 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-69b83851-b548-46b5-92bf-7be7b18ca546 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:27:59.550739 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-69b83851-b548-46b5-92bf-7be7b18ca546 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1265 microversion: 2.1 time: 0.179275 Jun 28 03:27:59.551562 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 491/974] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:27:59 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:28:00.572663 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-2e6f85f8-bcab-41af-be72-d3edd02d994d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:00.573560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-2e6f85f8-bcab-41af-be72-d3edd02d994d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:00.583576 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2e6f85f8-bcab-41af-be72-d3edd02d994d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:00.584322 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2e6f85f8-bcab-41af-be72-d3edd02d994d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:00.585536 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2e6f85f8-bcab-41af-be72-d3edd02d994d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:00.586206 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-2e6f85f8-bcab-41af-be72-d3edd02d994d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:00.720676 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-2e6f85f8-bcab-41af-be72-d3edd02d994d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:28:00.729151 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-2e6f85f8-bcab-41af-be72-d3edd02d994d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1265 microversion: 2.1 time: 0.164148 Jun 28 03:28:00.729721 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 484/975] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:28:00 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:28:01.384037 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-6228ae59-bbfa-497e-ae74-c05aeefb2479 req-c2de80f4-1670-479b-98a6-d58b96029936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d15481-1950-4451-a558-876c37530561", "name": "network-vif-plugged", "status": "completed", "tag": "3e2db863-652b-415d-8de9-73dd5344769a"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:28:01.388227 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:28:01.394725 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-6228ae59-bbfa-497e-ae74-c05aeefb2479 req-c2de80f4-1670-479b-98a6-d58b96029936 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:01.395433 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-6228ae59-bbfa-497e-ae74-c05aeefb2479 req-c2de80f4-1670-479b-98a6-d58b96029936 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:01.409912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-6228ae59-bbfa-497e-ae74-c05aeefb2479 req-c2de80f4-1670-479b-98a6-d58b96029936 service nova] Creating event network-vif-plugged:3e2db863-652b-415d-8de9-73dd5344769a for instance b3d15481-1950-4451-a558-876c37530561 on hv-cinder-84684 Jun 28 03:28:01.415274 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-6228ae59-bbfa-497e-ae74-c05aeefb2479 req-c2de80f4-1670-479b-98a6-d58b96029936 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034988 Jun 28 03:28:01.416353 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 492/976] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:28:01.746524 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ce121b66-b2f6-4f82-b812-db817872e304 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:01.747125 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ce121b66-b2f6-4f82-b812-db817872e304 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:01.753847 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ce121b66-b2f6-4f82-b812-db817872e304 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:01.754279 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ce121b66-b2f6-4f82-b812-db817872e304 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:01.755149 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ce121b66-b2f6-4f82-b812-db817872e304 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:01.755581 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ce121b66-b2f6-4f82-b812-db817872e304 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:01.893107 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-ce121b66-b2f6-4f82-b812-db817872e304 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:28:01.902595 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ce121b66-b2f6-4f82-b812-db817872e304 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1265 microversion: 2.1 time: 0.160020 Jun 28 03:28:01.903161 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 485/977] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:28:01 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:28:02.925324 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3de854bf-0ec1-4a97-b362-c83904c1c64f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:02.926423 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3de854bf-0ec1-4a97-b362-c83904c1c64f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:02.938543 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3de854bf-0ec1-4a97-b362-c83904c1c64f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:02.939016 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3de854bf-0ec1-4a97-b362-c83904c1c64f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:02.939774 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3de854bf-0ec1-4a97-b362-c83904c1c64f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:02.940201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3de854bf-0ec1-4a97-b362-c83904c1c64f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:03.090251 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3de854bf-0ec1-4a97-b362-c83904c1c64f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:28:03.098688 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3de854bf-0ec1-4a97-b362-c83904c1c64f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1451 microversion: 2.1 time: 0.181903 Jun 28 03:28:03.099596 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 493/978] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:28:02 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1451 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:28:03.114965 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-adc83316-df37-439a-b7d0-8470e9e30b67 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:03.115568 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-adc83316-df37-439a-b7d0-8470e9e30b67 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:03.122275 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-adc83316-df37-439a-b7d0-8470e9e30b67 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:03.122720 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-adc83316-df37-439a-b7d0-8470e9e30b67 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:03.123473 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-adc83316-df37-439a-b7d0-8470e9e30b67 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:03.123901 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-adc83316-df37-439a-b7d0-8470e9e30b67 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:03.266806 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-adc83316-df37-439a-b7d0-8470e9e30b67 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:28:03.274495 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-adc83316-df37-439a-b7d0-8470e9e30b67 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1451 microversion: 2.1 time: 0.163508 Jun 28 03:28:03.275064 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 486/979] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:28:03 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:28:05.178587 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-6ea49975-96df-4373-a648-76bfb0ca7596 req-7135d29a-bce2-43c3-9b70-d601f7182e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3d15481-1950-4451-a558-876c37530561", "tag": "3e2db863-652b-415d-8de9-73dd5344769a"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:28:05.188331 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-6ea49975-96df-4373-a648-76bfb0ca7596 req-7135d29a-bce2-43c3-9b70-d601f7182e52 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:05.188859 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-6ea49975-96df-4373-a648-76bfb0ca7596 req-7135d29a-bce2-43c3-9b70-d601f7182e52 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:05.200678 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-6ea49975-96df-4373-a648-76bfb0ca7596 req-7135d29a-bce2-43c3-9b70-d601f7182e52 service nova] Creating event network-changed:3e2db863-652b-415d-8de9-73dd5344769a for instance b3d15481-1950-4451-a558-876c37530561 on hv-cinder-84684 Jun 28 03:28:05.206653 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-6ea49975-96df-4373-a648-76bfb0ca7596 req-7135d29a-bce2-43c3-9b70-d601f7182e52 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031981 Jun 28 03:28:05.207486 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 494/980] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:28:35.297426 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-86527414-8592-4d86-83fa-91ee3541b384 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:35.298086 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-86527414-8592-4d86-83fa-91ee3541b384 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:35.301239 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=12 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:28:35.301947 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=66 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:28:35.309838 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-86527414-8592-4d86-83fa-91ee3541b384 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:35.310460 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-86527414-8592-4d86-83fa-91ee3541b384 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:35.311530 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-86527414-8592-4d86-83fa-91ee3541b384 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:35.312206 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-86527414-8592-4d86-83fa-91ee3541b384 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:35.339664 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-86527414-8592-4d86-83fa-91ee3541b384 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/ips" status: 200 len: 147 microversion: 2.1 time: 0.052553 Jun 28 03:28:35.340262 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 487/981] 10.222.0.44 () {58 vars in 1247 bytes} [Tue Jun 28 03:28:35 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/ips => generated 147 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:28:36.672389 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=5 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:28:36.673143 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=82 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:28:36.677476 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-673e857f-0689-44ad-bf20-9a721ed6adda tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5c3218f-989f-4e06-8014-fcb8dc30e974"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:28:36.678634 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-673e857f-0689-44ad-bf20-9a721ed6adda tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:36.686159 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-673e857f-0689-44ad-bf20-9a721ed6adda tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:36.686589 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-673e857f-0689-44ad-bf20-9a721ed6adda tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:36.687349 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-673e857f-0689-44ad-bf20-9a721ed6adda tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:36.687780 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-673e857f-0689-44ad-bf20-9a721ed6adda tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:36.970848 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-673e857f-0689-44ad-bf20-9a721ed6adda tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "POST /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299936 Jun 28 03:28:36.971870 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 495/982] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:28:36 2022] POST /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:28:44.546553 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-b44896d1-54c2-4ee0-8c7b-b54db3eb1ffd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:44.547555 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-b44896d1-54c2-4ee0-8c7b-b54db3eb1ffd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:44.555186 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b44896d1-54c2-4ee0-8c7b-b54db3eb1ffd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:44.555633 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b44896d1-54c2-4ee0-8c7b-b54db3eb1ffd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:44.556432 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b44896d1-54c2-4ee0-8c7b-b54db3eb1ffd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:44.556864 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-b44896d1-54c2-4ee0-8c7b-b54db3eb1ffd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:44.589542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-b44896d1-54c2-4ee0-8c7b-b54db3eb1ffd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046936 Jun 28 03:28:44.590086 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 488/983] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:28:44 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:28:44.606822 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-90b426a3-a718-48bf-81ad-edf162bca241 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:44.607660 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-90b426a3-a718-48bf-81ad-edf162bca241 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:44.616403 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-90b426a3-a718-48bf-81ad-edf162bca241 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:44.616857 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-90b426a3-a718-48bf-81ad-edf162bca241 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:44.617617 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-90b426a3-a718-48bf-81ad-edf162bca241 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:44.618045 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-90b426a3-a718-48bf-81ad-edf162bca241 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:44.648198 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-90b426a3-a718-48bf-81ad-edf162bca241 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments/d5c3218f-989f-4e06-8014-fcb8dc30e974" status: 200 len: 194 microversion: 2.1 time: 0.048491 Jun 28 03:28:44.648807 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 496/984] 10.222.0.44 () {58 vars in 1412 bytes} [Tue Jun 28 03:28:44 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments/d5c3218f-989f-4e06-8014-fcb8dc30e974 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:28:45.983555 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ee16b2f7-e3c4-49b0-983e-a9a9c4578bec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e704673-4da5-4295-8405-2be1be3bb05e"}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:28:45.985223 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ee16b2f7-e3c4-49b0-983e-a9a9c4578bec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:45.994292 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ee16b2f7-e3c4-49b0-983e-a9a9c4578bec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:45.994719 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ee16b2f7-e3c4-49b0-983e-a9a9c4578bec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:45.995481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ee16b2f7-e3c4-49b0-983e-a9a9c4578bec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:45.995910 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ee16b2f7-e3c4-49b0-983e-a9a9c4578bec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:46.273584 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ee16b2f7-e3c4-49b0-983e-a9a9c4578bec tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "POST /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296266 Jun 28 03:28:46.274191 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 489/985] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:28:45 2022] POST /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:28:53.826260 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8091a1f3-ea04-4438-ae8a-d5c5c064e23c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:53.827246 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8091a1f3-ea04-4438-ae8a-d5c5c064e23c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:53.834021 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8091a1f3-ea04-4438-ae8a-d5c5c064e23c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:53.834457 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8091a1f3-ea04-4438-ae8a-d5c5c064e23c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:53.835374 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8091a1f3-ea04-4438-ae8a-d5c5c064e23c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:53.835807 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8091a1f3-ea04-4438-ae8a-d5c5c064e23c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:53.867298 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8091a1f3-ea04-4438-ae8a-d5c5c064e23c tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045008 Jun 28 03:28:53.867874 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 497/986] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:28:53 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:28:54.017541 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f52db56f-9c85-419b-9482-df50d68b4ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:54.018395 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f52db56f-9c85-419b-9482-df50d68b4ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:54.026779 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f52db56f-9c85-419b-9482-df50d68b4ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:54.027219 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f52db56f-9c85-419b-9482-df50d68b4ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:54.027971 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f52db56f-9c85-419b-9482-df50d68b4ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:54.028432 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f52db56f-9c85-419b-9482-df50d68b4ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:54.057242 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f52db56f-9c85-419b-9482-df50d68b4ce5 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments/d5c3218f-989f-4e06-8014-fcb8dc30e974" status: 200 len: 194 microversion: 2.1 time: 0.047134 Jun 28 03:28:54.057815 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 490/987] 10.222.0.44 () {58 vars in 1412 bytes} [Tue Jun 28 03:28:54 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments/d5c3218f-989f-4e06-8014-fcb8dc30e974 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:28:54.072648 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-efd43fd8-3042-4a96-989b-cf94bf0a7a5a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:54.073375 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-efd43fd8-3042-4a96-989b-cf94bf0a7a5a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:54.083211 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-efd43fd8-3042-4a96-989b-cf94bf0a7a5a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:54.083979 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-efd43fd8-3042-4a96-989b-cf94bf0a7a5a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:54.085140 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-efd43fd8-3042-4a96-989b-cf94bf0a7a5a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:54.085579 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-efd43fd8-3042-4a96-989b-cf94bf0a7a5a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:54.181512 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-efd43fd8-3042-4a96-989b-cf94bf0a7a5a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lazy-loading 'services' on Instance uuid 15b9432b-54cd-48ff-b183-6a5eac7f0a3b {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:28:54.256421 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-efd43fd8-3042-4a96-989b-cf94bf0a7a5a tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "DELETE /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments/d5c3218f-989f-4e06-8014-fcb8dc30e974" status: 202 len: 0 microversion: 2.1 time: 0.190191 Jun 28 03:28:54.257093 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 498/988] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 28 03:28:54 2022] DELETE /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments/d5c3218f-989f-4e06-8014-fcb8dc30e974 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:28:56.439491 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3b8eb284-7890-4884-ba88-05d980fde2bd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:56.440021 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-3b8eb284-7890-4884-ba88-05d980fde2bd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:56.446846 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3b8eb284-7890-4884-ba88-05d980fde2bd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:56.447287 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3b8eb284-7890-4884-ba88-05d980fde2bd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:56.448037 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3b8eb284-7890-4884-ba88-05d980fde2bd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:56.448499 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-3b8eb284-7890-4884-ba88-05d980fde2bd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:56.478184 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3b8eb284-7890-4884-ba88-05d980fde2bd tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments/5e704673-4da5-4295-8405-2be1be3bb05e" status: 200 len: 194 microversion: 2.1 time: 0.042649 Jun 28 03:28:56.478751 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 491/989] 10.222.0.44 () {58 vars in 1412 bytes} [Tue Jun 28 03:28:56 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments/5e704673-4da5-4295-8405-2be1be3bb05e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:28:56.489551 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-89e2a10f-b117-44a4-b30f-bdb3766ca99f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:56.490085 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-89e2a10f-b117-44a4-b30f-bdb3766ca99f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:56.496716 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-89e2a10f-b117-44a4-b30f-bdb3766ca99f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:56.497162 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-89e2a10f-b117-44a4-b30f-bdb3766ca99f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:56.497910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-89e2a10f-b117-44a4-b30f-bdb3766ca99f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:56.498335 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-89e2a10f-b117-44a4-b30f-bdb3766ca99f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:56.581218 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-89e2a10f-b117-44a4-b30f-bdb3766ca99f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lazy-loading 'services' on Instance uuid 15b9432b-54cd-48ff-b183-6a5eac7f0a3b {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:28:56.656967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-89e2a10f-b117-44a4-b30f-bdb3766ca99f tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "DELETE /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments/5e704673-4da5-4295-8405-2be1be3bb05e" status: 202 len: 0 microversion: 2.1 time: 0.172023 Jun 28 03:28:56.657540 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 499/990] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 28 03:28:56 2022] DELETE /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments/5e704673-4da5-4295-8405-2be1be3bb05e => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:28:57.818442 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-adf34f99-9d82-41f1-9ef1-0ff1f54fd3bb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:57.819427 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-adf34f99-9d82-41f1-9ef1-0ff1f54fd3bb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:57.826137 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-adf34f99-9d82-41f1-9ef1-0ff1f54fd3bb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:57.826585 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-adf34f99-9d82-41f1-9ef1-0ff1f54fd3bb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:57.827344 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-adf34f99-9d82-41f1-9ef1-0ff1f54fd3bb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:57.827771 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-adf34f99-9d82-41f1-9ef1-0ff1f54fd3bb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:57.858570 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-adf34f99-9d82-41f1-9ef1-0ff1f54fd3bb tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044216 Jun 28 03:28:57.859114 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 492/991] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:28:57 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 03:28:57.968646 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0b68f92c-4d08-49c0-b646-c5b1eaf77695 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:57.969661 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0b68f92c-4d08-49c0-b646-c5b1eaf77695 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:57.977017 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0b68f92c-4d08-49c0-b646-c5b1eaf77695 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:57.978163 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0b68f92c-4d08-49c0-b646-c5b1eaf77695 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:57.979331 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0b68f92c-4d08-49c0-b646-c5b1eaf77695 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:57.980195 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0b68f92c-4d08-49c0-b646-c5b1eaf77695 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:58.014169 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0b68f92c-4d08-49c0-b646-c5b1eaf77695 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050394 Jun 28 03:28:58.014737 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 500/992] 10.222.0.44 () {58 vars in 1301 bytes} [Tue Jun 28 03:28:57 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 28 03:28:58.073352 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e0f35c8a-b2cc-4757-a07b-2c163058b6c0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:58.073974 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e0f35c8a-b2cc-4757-a07b-2c163058b6c0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:58.080123 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e0f35c8a-b2cc-4757-a07b-2c163058b6c0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:58.080603 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e0f35c8a-b2cc-4757-a07b-2c163058b6c0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:58.081357 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e0f35c8a-b2cc-4757-a07b-2c163058b6c0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:58.081787 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e0f35c8a-b2cc-4757-a07b-2c163058b6c0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:58.107795 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e0f35c8a-b2cc-4757-a07b-2c163058b6c0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Going to try to terminate instance {{(pid=117681) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:28:58.191304 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e0f35c8a-b2cc-4757-a07b-2c163058b6c0 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "DELETE /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 204 len: 0 microversion: 2.1 time: 0.121676 Jun 28 03:28:58.191922 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 493/993] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:28:58 2022] DELETE /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:28:58.201299 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ca49c139-7153-4072-b91b-9ef7305d1b64 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:58.202229 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ca49c139-7153-4072-b91b-9ef7305d1b64 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:58.211292 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ca49c139-7153-4072-b91b-9ef7305d1b64 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:58.211922 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ca49c139-7153-4072-b91b-9ef7305d1b64 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:58.212806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ca49c139-7153-4072-b91b-9ef7305d1b64 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:58.213392 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ca49c139-7153-4072-b91b-9ef7305d1b64 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:58.354021 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ca49c139-7153-4072-b91b-9ef7305d1b64 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:28:58.362247 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ca49c139-7153-4072-b91b-9ef7305d1b64 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1675 microversion: 2.1 time: 0.165981 Jun 28 03:28:58.362809 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 501/994] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:28:58 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 28 03:28:59.385486 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-dd19d6ce-1d06-41ef-8733-ddfbd1050899 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:28:59.386636 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-dd19d6ce-1d06-41ef-8733-ddfbd1050899 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:28:59.397919 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dd19d6ce-1d06-41ef-8733-ddfbd1050899 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:59.398654 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dd19d6ce-1d06-41ef-8733-ddfbd1050899 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:59.399991 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dd19d6ce-1d06-41ef-8733-ddfbd1050899 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:28:59.400709 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dd19d6ce-1d06-41ef-8733-ddfbd1050899 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:28:59.546845 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-dd19d6ce-1d06-41ef-8733-ddfbd1050899 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:28:59.555057 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-dd19d6ce-1d06-41ef-8733-ddfbd1050899 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1675 microversion: 2.1 time: 0.176912 Jun 28 03:28:59.555639 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 494/995] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:28:59 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:29:00.573705 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-89f4fc7e-57bd-4130-aada-094bd6e1e2be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:00.574298 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-89f4fc7e-57bd-4130-aada-094bd6e1e2be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:00.581519 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-89f4fc7e-57bd-4130-aada-094bd6e1e2be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:00.581967 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-89f4fc7e-57bd-4130-aada-094bd6e1e2be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:00.583833 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-89f4fc7e-57bd-4130-aada-094bd6e1e2be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:00.584362 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-89f4fc7e-57bd-4130-aada-094bd6e1e2be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:00.660547 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-89f4fc7e-57bd-4130-aada-094bd6e1e2be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efee06a99e04a349f314b7c6c44837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fae3b890884f28a70d0ccc855d5365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:29:00.669158 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-89f4fc7e-57bd-4130-aada-094bd6e1e2be tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 200 len: 1607 microversion: 2.1 time: 0.099929 Jun 28 03:29:00.669745 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 502/996] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:29:00 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 1607 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:29:01.064526 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-e374ba96-cfac-4284-b9f3-51e8185105cc req-8a2a5a4c-0803-4c80-a671-b78ac8afdc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b9432b-54cd-48ff-b183-6a5eac7f0a3b", "name": "network-vif-deleted", "tag": "db32f36e-d5cf-4d1a-bf73-975e7af752f3"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:29:01.074428 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-e374ba96-cfac-4284-b9f3-51e8185105cc req-8a2a5a4c-0803-4c80-a671-b78ac8afdc22 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:01.075138 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-e374ba96-cfac-4284-b9f3-51e8185105cc req-8a2a5a4c-0803-4c80-a671-b78ac8afdc22 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:01.089686 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-e374ba96-cfac-4284-b9f3-51e8185105cc req-8a2a5a4c-0803-4c80-a671-b78ac8afdc22 service nova] Creating event network-vif-deleted:db32f36e-d5cf-4d1a-bf73-975e7af752f3 for instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b on hv-cinder-84684 Jun 28 03:29:01.095053 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-e374ba96-cfac-4284-b9f3-51e8185105cc req-8a2a5a4c-0803-4c80-a671-b78ac8afdc22 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188460 Jun 28 03:29:01.095979 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 495/997] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:29:01.687721 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a9c66048-40bf-4dc0-8050-9bc15134aa27 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:01.688377 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a9c66048-40bf-4dc0-8050-9bc15134aa27 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:01.695472 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a9c66048-40bf-4dc0-8050-9bc15134aa27 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:01.695909 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a9c66048-40bf-4dc0-8050-9bc15134aa27 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:01.696690 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a9c66048-40bf-4dc0-8050-9bc15134aa27 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:01.697683 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a9c66048-40bf-4dc0-8050-9bc15134aa27 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:01.711415 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-a9c66048-40bf-4dc0-8050-9bc15134aa27 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] HTTP exception thrown: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a9c66048-40bf-4dc0-8050-9bc15134aa27 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Request method failure captured: Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b HTTP/1.1 Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunRqajM1putZtXFgXYsipiMkAdBHXaim_McJ8gBdTAqXsSzY9tJpOaQDleBkTUWXffmw3d2P93qUarAhffuhW1xy2iDjLeBboCba8hgaVQ-MahD4QEsKC2lFJ3Xeg8DowIuSn83PikjKqF6Csp6S5dxmmY9RgJsdp8SLlue0VatSAGg Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: d4fae3b890884f28a70d0ccc855d5365 Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:29:01.713345 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:29:01.714969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d4fae3b890884f28a70d0ccc855d5365", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:29:01.714969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:01.714969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: d4fae3b890884f28a70d0ccc855d5365 Jun 28 03:29:01.714969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:01.714969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeTestJSON-1617728001-project Jun 28 03:29:01.714969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:29:01.714969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:29:01.714969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 5efee06a99e04a349f314b7c6c44837b Jun 28 03:29:01.714969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeTestJSON-1617728001-project Jun 28 03:29:01.714969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:29:01.714969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:01.714969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '15b9432b-54cd-48ff-b183-6a5eac7f0a3b'} Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:29:01.716091 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:01.717722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:01.719797 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a9c66048-40bf-4dc0-8050-9bc15134aa27 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Returning 404 to user: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:29:01.719797 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a9c66048-40bf-4dc0-8050-9bc15134aa27 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 404 len: 111 microversion: 2.1 time: 0.031076 Jun 28 03:29:01.719797 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 503/998] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:29:01 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:29:01.728058 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-baba48fa-8c2e-49a2-bdb3-1c972f2d4986 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '.version_select at 0x7f53f1f12430>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:01.752602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-baba48fa-8c2e-49a2-bdb3-1c972f2d4986 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374566449" status: 202 len: 0 microversion: 2.1 time: 0.028674 Jun 28 03:29:01.753253 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 496/999] 10.222.0.44 () {58 vars in 1220 bytes} [Tue Jun 28 03:29:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1374566449 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:29:04.677642 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6083091a-fd71-49e7-998c-c1c8213c5167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:04.678201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6083091a-fd71-49e7-998c-c1c8213c5167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:04.686981 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6083091a-fd71-49e7-998c-c1c8213c5167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:04.687428 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6083091a-fd71-49e7-998c-c1c8213c5167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:04.688193 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6083091a-fd71-49e7-998c-c1c8213c5167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:04.688661 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6083091a-fd71-49e7-998c-c1c8213c5167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:04.703023 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-6083091a-fd71-49e7-998c-c1c8213c5167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] HTTP exception thrown: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6083091a-fd71-49e7-998c-c1c8213c5167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Request method failure captured: Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: DELETE /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b HTTP/1.1 Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunRqajM1putZtXFgXYsipiMkAdBHXaim_McJ8gBdTAqXsSzY9tJpOaQDleBkTUWXffmw3d2P93qUarAhffuhW1xy2iDjLeBboCba8hgaVQ-MahD4QEsKC2lFJ3Xeg8DowIuSn83PikjKqF6Csp6S5dxmmY9RgJsdp8SLlue0VatSAGg Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: d4fae3b890884f28a70d0ccc855d5365 Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:29:04.704621 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:29:04.706201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d4fae3b890884f28a70d0ccc855d5365", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:29:04.706201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:04.706201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: d4fae3b890884f28a70d0ccc855d5365 Jun 28 03:29:04.706201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:04.706201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeTestJSON-1617728001-project Jun 28 03:29:04.706201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:29:04.706201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:29:04.706201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 5efee06a99e04a349f314b7c6c44837b Jun 28 03:29:04.706201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeTestJSON-1617728001-project Jun 28 03:29:04.706201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:29:04.706201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:04.706201 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '15b9432b-54cd-48ff-b183-6a5eac7f0a3b'} Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:29:04.707042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:04.708371 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:04.709824 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6083091a-fd71-49e7-998c-c1c8213c5167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Returning 404 to user: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:29:04.709824 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6083091a-fd71-49e7-998c-c1c8213c5167 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "DELETE /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 404 len: 111 microversion: 2.1 time: 0.034374 Jun 28 03:29:04.709824 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 504/1000] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:29:04 2022] DELETE /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:29:04.718506 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-1d87b7fd-081a-482a-8a9d-40b9fad232c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:04.719397 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-1d87b7fd-081a-482a-8a9d-40b9fad232c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 15b9432b-54cd-48ff-b183-6a5eac7f0a3b] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:04.729127 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1d87b7fd-081a-482a-8a9d-40b9fad232c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:04.729572 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1d87b7fd-081a-482a-8a9d-40b9fad232c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:04.730321 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1d87b7fd-081a-482a-8a9d-40b9fad232c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:04.730727 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1d87b7fd-081a-482a-8a9d-40b9fad232c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:04.744450 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-1d87b7fd-081a-482a-8a9d-40b9fad232c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] HTTP exception thrown: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-1d87b7fd-081a-482a-8a9d-40b9fad232c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Request method failure captured: Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b HTTP/1.1 Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunRqajM1putZtXFgXYsipiMkAdBHXaim_McJ8gBdTAqXsSzY9tJpOaQDleBkTUWXffmw3d2P93qUarAhffuhW1xy2iDjLeBboCba8hgaVQ-MahD4QEsKC2lFJ3Xeg8DowIuSn83PikjKqF6Csp6S5dxmmY9RgJsdp8SLlue0VatSAGg Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: d4fae3b890884f28a70d0ccc855d5365 Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:29:04.746135 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:29:04.747560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d4fae3b890884f28a70d0ccc855d5365", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:29:04.747560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:04.747560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: d4fae3b890884f28a70d0ccc855d5365 Jun 28 03:29:04.747560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:04.747560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-AttachVolumeTestJSON-1617728001-project Jun 28 03:29:04.747560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:29:04.747560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:29:04.747560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 5efee06a99e04a349f314b7c6c44837b Jun 28 03:29:04.747560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-AttachVolumeTestJSON-1617728001-project Jun 28 03:29:04.747560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:29:04.747560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:04.747560 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '15b9432b-54cd-48ff-b183-6a5eac7f0a3b'} Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:29:04.748544 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. Jun 28 03:29:04.749921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:29:04.751310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-1d87b7fd-081a-482a-8a9d-40b9fad232c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Returning 404 to user: Instance 15b9432b-54cd-48ff-b183-6a5eac7f0a3b could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:29:04.751310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-1d87b7fd-081a-482a-8a9d-40b9fad232c7 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b" status: 404 len: 111 microversion: 2.1 time: 0.036660 Jun 28 03:29:04.751310 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 497/1001] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:29:04 2022] GET /compute/v2.1/servers/15b9432b-54cd-48ff-b183-6a5eac7f0a3b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:29:05.908927 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a2afe70a-5e04-43b3-aa91-759c41c472a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:05.909434 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a2afe70a-5e04-43b3-aa91-759c41c472a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:05.916449 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2afe70a-5e04-43b3-aa91-759c41c472a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:05.916902 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2afe70a-5e04-43b3-aa91-759c41c472a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:05.917651 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2afe70a-5e04-43b3-aa91-759c41c472a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:05.918081 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2afe70a-5e04-43b3-aa91-759c41c472a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:05.932020 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-a2afe70a-5e04-43b3-aa91-759c41c472a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] HTTP exception thrown: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a2afe70a-5e04-43b3-aa91-759c41c472a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Request method failure captured: Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: DELETE /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 HTTP/1.1 Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunRqajM1putZtXFgXYsipiMkAdBHXaim_McJ8gBdTAqXsSzY9tJpOaQDleBkTUWXffmw3d2P93qUarAhffuhW1xy2iDjLeBboCba8hgaVQ-MahD4QEsKC2lFJ3Xeg8DowIuSn83PikjKqF6Csp6S5dxmmY9RgJsdp8SLlue0VatSAGg Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: d4fae3b890884f28a70d0ccc855d5365 Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:29:05.933595 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:29:05.935166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d4fae3b890884f28a70d0ccc855d5365", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:29:05.935166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:05.935166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: d4fae3b890884f28a70d0ccc855d5365 Jun 28 03:29:05.935166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:05.935166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeTestJSON-1617728001-project Jun 28 03:29:05.935166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:29:05.935166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:29:05.935166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 5efee06a99e04a349f314b7c6c44837b Jun 28 03:29:05.935166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeTestJSON-1617728001-project Jun 28 03:29:05.935166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:29:05.935166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:29:05.935166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': '785c405e-c17b-4e21-b51e-f645dd26f9b9'} Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:29:05.935956 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:29:05.937466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:29:05.938852 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a2afe70a-5e04-43b3-aa91-759c41c472a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Returning 404 to user: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:29:05.938852 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a2afe70a-5e04-43b3-aa91-759c41c472a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "DELETE /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 404 len: 111 microversion: 2.1 time: 0.029922 Jun 28 03:29:05.938852 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 505/1002] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:29:05 2022] DELETE /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:29:05.943559 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-964c292f-e040-41e5-bdc3-11e67f0fa1a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:05.944186 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-964c292f-e040-41e5-bdc3-11e67f0fa1a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] [instance: 785c405e-c17b-4e21-b51e-f645dd26f9b9] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:05.946660 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:29:05.952222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-964c292f-e040-41e5-bdc3-11e67f0fa1a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:05.952565 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-964c292f-e040-41e5-bdc3-11e67f0fa1a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:05.953328 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-964c292f-e040-41e5-bdc3-11e67f0fa1a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:05.953760 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-964c292f-e040-41e5-bdc3-11e67f0fa1a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:05.958390 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:29:05.969791 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-964c292f-e040-41e5-bdc3-11e67f0fa1a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] HTTP exception thrown: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-964c292f-e040-41e5-bdc3-11e67f0fa1a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Request method failure captured: Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 HTTP/1.1 Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunRqajM1putZtXFgXYsipiMkAdBHXaim_McJ8gBdTAqXsSzY9tJpOaQDleBkTUWXffmw3d2P93qUarAhffuhW1xy2iDjLeBboCba8hgaVQ-MahD4QEsKC2lFJ3Xeg8DowIuSn83PikjKqF6Csp6S5dxmmY9RgJsdp8SLlue0VatSAGg Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: d4fae3b890884f28a70d0ccc855d5365 Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:29:05.971305 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:29:05.973222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d4fae3b890884f28a70d0ccc855d5365", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d4fae3b890884f28a70d0ccc855d5365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:29:05.973222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:05.973222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: d4fae3b890884f28a70d0ccc855d5365 Jun 28 03:29:05.973222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1617728001 Jun 28 03:29:05.973222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-AttachVolumeTestJSON-1617728001-project Jun 28 03:29:05.973222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:29:05.973222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:29:05.973222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 5efee06a99e04a349f314b7c6c44837b Jun 28 03:29:05.973222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-AttachVolumeTestJSON-1617728001-project Jun 28 03:29:05.973222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:29:05.973222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:29:05.973222 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '785c405e-c17b-4e21-b51e-f645dd26f9b9'} Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:29:05.974051 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. Jun 28 03:29:05.975331 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:29:05.976428 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-964c292f-e040-41e5-bdc3-11e67f0fa1a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] Returning 404 to user: Instance 785c405e-c17b-4e21-b51e-f645dd26f9b9 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:29:05.976428 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-964c292f-e040-41e5-bdc3-11e67f0fa1a1 tempest-AttachVolumeTestJSON-1617728001 tempest-AttachVolumeTestJSON-1617728001-project] 10.222.0.44 "GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9" status: 404 len: 111 microversion: 2.1 time: 0.033452 Jun 28 03:29:05.976428 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 498/1003] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:29:05 2022] GET /compute/v2.1/servers/785c405e-c17b-4e21-b51e-f645dd26f9b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:29:43.132391 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 03:29:43.132901 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Tue Jun 28 03:29:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 03:29:50.227041 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1671573054", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1536016975", "security_groups": [{"name": "tempest-secgroup-smoke-1125387860"}], "block_device_mapping_v2": [{"uuid": "6c26d6d8-c60c-4f3a-b076-e215c3374d68", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fa3b8415-5dcf-451a-a58a-63fa23e098ab"}]}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:29:50.237524 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=22 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:29:50.238164 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:29:50.348748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] validate_networks() for [('fa3b8415-5dcf-451a-a58a-63fa23e098ab', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:29:50.845442 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:29:50.845854 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:29:50.846348 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:29:50.846738 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:29:50.847152 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:29:50.856205 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:50.856644 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:50.857416 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:50.858045 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:50.876376 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Getting quotas for project cc2d6ae6d1f74852b9b51d970d19d0df. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:29:50.880908 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Getting quotas for user 3480ec26f30343e58a5e7b5329cb2cce and project cc2d6ae6d1f74852b9b51d970d19d0df. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:29:50.940626 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:29:50.942969 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c26d6d8-c60c-4f3a-b076-e215c3374d68',volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:29:51.101125 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6d5a7c0f-6b56-43a9-a92f-60e841ea5668 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.878358 Jun 28 03:29:51.106768 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 506/1004] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:29:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:29:51.112645 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-079d6499-b01b-4fcd-a0c9-b4b636ea76a4 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:51.113355 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-079d6499-b01b-4fcd-a0c9-b4b636ea76a4 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:51.118687 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:29:51.179057 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-079d6499-b01b-4fcd-a0c9-b4b636ea76a4 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:29:51.187109 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-079d6499-b01b-4fcd-a0c9-b4b636ea76a4 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1095 microversion: 2.1 time: 0.079070 Jun 28 03:29:51.187644 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 499/1005] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:29:51 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:29:52.204523 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-014cd0f3-937a-4b24-9ab7-cd5a7565702b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:52.205790 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-014cd0f3-937a-4b24-9ab7-cd5a7565702b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:52.220883 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-014cd0f3-937a-4b24-9ab7-cd5a7565702b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:52.221326 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-014cd0f3-937a-4b24-9ab7-cd5a7565702b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:52.222121 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-014cd0f3-937a-4b24-9ab7-cd5a7565702b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:52.222536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-014cd0f3-937a-4b24-9ab7-cd5a7565702b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:52.290451 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-014cd0f3-937a-4b24-9ab7-cd5a7565702b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:29:52.300077 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-014cd0f3-937a-4b24-9ab7-cd5a7565702b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1201 microversion: 2.1 time: 0.099625 Jun 28 03:29:52.300674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 507/1006] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:29:52 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1201 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:29:53.318554 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f3d67df2-4232-475d-ae1b-28102f34054f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:53.319148 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f3d67df2-4232-475d-ae1b-28102f34054f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:53.327633 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f3d67df2-4232-475d-ae1b-28102f34054f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:53.328076 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f3d67df2-4232-475d-ae1b-28102f34054f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:53.328881 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f3d67df2-4232-475d-ae1b-28102f34054f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:53.329339 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f3d67df2-4232-475d-ae1b-28102f34054f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:53.467964 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-f3d67df2-4232-475d-ae1b-28102f34054f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:29:53.476077 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f3d67df2-4232-475d-ae1b-28102f34054f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.161573 Jun 28 03:29:53.476654 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 500/1007] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:29:53 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:29:53.865499 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-d1e6aa45-ed83-40b3-8ffc-07bcb612c83c req-3c025c88-4046-40df-837d-4540ffff91ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2af0949-b2f6-49e1-add2-7d85b03ea3ee", "tag": "f43b1e9e-3571-489a-8a6f-25c327d5fa89"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:29:53.881882 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-d1e6aa45-ed83-40b3-8ffc-07bcb612c83c req-3c025c88-4046-40df-837d-4540ffff91ee service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:53.882321 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-d1e6aa45-ed83-40b3-8ffc-07bcb612c83c req-3c025c88-4046-40df-837d-4540ffff91ee service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:53.906803 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-d1e6aa45-ed83-40b3-8ffc-07bcb612c83c req-3c025c88-4046-40df-837d-4540ffff91ee service nova] Creating event network-changed:f43b1e9e-3571-489a-8a6f-25c327d5fa89 for instance a2af0949-b2f6-49e1-add2-7d85b03ea3ee on hv-cinder-84684 Jun 28 03:29:53.911893 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-d1e6aa45-ed83-40b3-8ffc-07bcb612c83c req-3c025c88-4046-40df-837d-4540ffff91ee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051045 Jun 28 03:29:53.912979 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 508/1008] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:29:54.493698 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d69eb3f1-6a00-48e8-8731-01a4236f86f0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:54.494301 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d69eb3f1-6a00-48e8-8731-01a4236f86f0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:54.501535 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d69eb3f1-6a00-48e8-8731-01a4236f86f0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:54.502032 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d69eb3f1-6a00-48e8-8731-01a4236f86f0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:54.502787 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d69eb3f1-6a00-48e8-8731-01a4236f86f0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:54.503211 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d69eb3f1-6a00-48e8-8731-01a4236f86f0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:54.646885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d69eb3f1-6a00-48e8-8731-01a4236f86f0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:29:54.655102 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d69eb3f1-6a00-48e8-8731-01a4236f86f0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.165349 Jun 28 03:29:54.655638 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 501/1009] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:29:54 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:29:55.673703 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b4d861bf-6f5c-4067-a308-96f3b68cd6d9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:55.674278 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b4d861bf-6f5c-4067-a308-96f3b68cd6d9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:55.682940 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b4d861bf-6f5c-4067-a308-96f3b68cd6d9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:55.683380 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b4d861bf-6f5c-4067-a308-96f3b68cd6d9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:55.684134 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b4d861bf-6f5c-4067-a308-96f3b68cd6d9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:55.684591 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b4d861bf-6f5c-4067-a308-96f3b68cd6d9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:55.855695 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b4d861bf-6f5c-4067-a308-96f3b68cd6d9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:29:55.863766 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b4d861bf-6f5c-4067-a308-96f3b68cd6d9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.194536 Jun 28 03:29:55.864508 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 509/1010] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:29:55 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:29:56.881246 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-47676958-0a08-4f35-b887-cda12c88e6f9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:56.881887 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-47676958-0a08-4f35-b887-cda12c88e6f9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:56.888741 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-47676958-0a08-4f35-b887-cda12c88e6f9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:56.889182 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-47676958-0a08-4f35-b887-cda12c88e6f9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:56.889936 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-47676958-0a08-4f35-b887-cda12c88e6f9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:56.890363 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-47676958-0a08-4f35-b887-cda12c88e6f9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:57.076023 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-47676958-0a08-4f35-b887-cda12c88e6f9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:29:57.083672 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-47676958-0a08-4f35-b887-cda12c88e6f9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.206331 Jun 28 03:29:57.084219 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 502/1011] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:29:56 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:29:58.101660 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b7c40a05-bdf4-4ee5-bad2-666c2cfc7daf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:58.102434 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b7c40a05-bdf4-4ee5-bad2-666c2cfc7daf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:58.109108 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b7c40a05-bdf4-4ee5-bad2-666c2cfc7daf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:58.109551 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b7c40a05-bdf4-4ee5-bad2-666c2cfc7daf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:58.110359 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b7c40a05-bdf4-4ee5-bad2-666c2cfc7daf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:58.110795 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b7c40a05-bdf4-4ee5-bad2-666c2cfc7daf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:58.245868 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b7c40a05-bdf4-4ee5-bad2-666c2cfc7daf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:29:58.254644 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b7c40a05-bdf4-4ee5-bad2-666c2cfc7daf tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.157462 Jun 28 03:29:58.255299 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 510/1012] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:29:58 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:29:59.274757 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d347ab65-7d86-4e35-8486-02253a2026c9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:29:59.275522 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d347ab65-7d86-4e35-8486-02253a2026c9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:29:59.284614 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d347ab65-7d86-4e35-8486-02253a2026c9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:59.285200 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d347ab65-7d86-4e35-8486-02253a2026c9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:59.286194 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d347ab65-7d86-4e35-8486-02253a2026c9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:29:59.286773 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d347ab65-7d86-4e35-8486-02253a2026c9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:29:59.431337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d347ab65-7d86-4e35-8486-02253a2026c9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:29:59.439001 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d347ab65-7d86-4e35-8486-02253a2026c9 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.170569 Jun 28 03:29:59.439570 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 503/1013] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:29:59 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:00.456872 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b630cba8-918a-48bd-8947-88e38fdce68c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:00.457497 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b630cba8-918a-48bd-8947-88e38fdce68c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:00.464486 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b630cba8-918a-48bd-8947-88e38fdce68c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:00.464934 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b630cba8-918a-48bd-8947-88e38fdce68c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:00.465706 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b630cba8-918a-48bd-8947-88e38fdce68c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:00.466130 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b630cba8-918a-48bd-8947-88e38fdce68c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:00.600493 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b630cba8-918a-48bd-8947-88e38fdce68c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:00.608845 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b630cba8-918a-48bd-8947-88e38fdce68c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.155921 Jun 28 03:30:00.609449 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 511/1014] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:00 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:01.630582 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-39f207a9-13f6-4c14-9a65-301a4e517fff tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:01.631511 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-39f207a9-13f6-4c14-9a65-301a4e517fff tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:01.635562 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:30:01.644495 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-39f207a9-13f6-4c14-9a65-301a4e517fff tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:01.645250 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-39f207a9-13f6-4c14-9a65-301a4e517fff tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:01.646529 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-39f207a9-13f6-4c14-9a65-301a4e517fff tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:01.647234 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-39f207a9-13f6-4c14-9a65-301a4e517fff tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:01.799284 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-39f207a9-13f6-4c14-9a65-301a4e517fff tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:01.807169 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-39f207a9-13f6-4c14-9a65-301a4e517fff tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.183219 Jun 28 03:30:01.807736 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 504/1015] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:01 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:02.829178 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5b88adfd-4230-43d1-9fb1-ecfca9909017 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:02.829748 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5b88adfd-4230-43d1-9fb1-ecfca9909017 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:02.831949 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:30:02.832764 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:30:02.839427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5b88adfd-4230-43d1-9fb1-ecfca9909017 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:02.839853 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5b88adfd-4230-43d1-9fb1-ecfca9909017 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:02.840653 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5b88adfd-4230-43d1-9fb1-ecfca9909017 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:02.841083 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5b88adfd-4230-43d1-9fb1-ecfca9909017 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:02.973838 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5b88adfd-4230-43d1-9fb1-ecfca9909017 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:02.981830 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5b88adfd-4230-43d1-9fb1-ecfca9909017 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.156510 Jun 28 03:30:02.982437 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 512/1016] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:02 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:04.002173 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-1c361ad2-e531-4235-a464-22a37655b67d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:04.002780 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-1c361ad2-e531-4235-a464-22a37655b67d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:04.011888 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1c361ad2-e531-4235-a464-22a37655b67d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:04.012379 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1c361ad2-e531-4235-a464-22a37655b67d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:04.013129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1c361ad2-e531-4235-a464-22a37655b67d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:04.013553 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1c361ad2-e531-4235-a464-22a37655b67d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:04.158228 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-1c361ad2-e531-4235-a464-22a37655b67d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:04.166099 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-1c361ad2-e531-4235-a464-22a37655b67d tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.171422 Jun 28 03:30:04.166664 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 505/1017] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:03 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:04.568413 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-d8108f4b-d5c1-4b80-98dc-2c2eecee92a7 req-f3733a61-6bfd-432c-bbdf-4f755fec5fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2af0949-b2f6-49e1-add2-7d85b03ea3ee", "name": "network-vif-plugged", "status": "completed", "tag": "f43b1e9e-3571-489a-8a6f-25c327d5fa89"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:30:04.576521 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-d8108f4b-d5c1-4b80-98dc-2c2eecee92a7 req-f3733a61-6bfd-432c-bbdf-4f755fec5fed service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:04.576961 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-d8108f4b-d5c1-4b80-98dc-2c2eecee92a7 req-f3733a61-6bfd-432c-bbdf-4f755fec5fed service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:04.587605 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-d8108f4b-d5c1-4b80-98dc-2c2eecee92a7 req-f3733a61-6bfd-432c-bbdf-4f755fec5fed service nova] Creating event network-vif-plugged:f43b1e9e-3571-489a-8a6f-25c327d5fa89 for instance a2af0949-b2f6-49e1-add2-7d85b03ea3ee on hv-cinder-84684 Jun 28 03:30:04.593197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-d8108f4b-d5c1-4b80-98dc-2c2eecee92a7 req-f3733a61-6bfd-432c-bbdf-4f755fec5fed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161777 Jun 28 03:30:04.593780 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 513/1018] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:30:05.185969 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-23b02426-0f90-4b17-9f39-c16d14f593ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:05.186720 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-23b02426-0f90-4b17-9f39-c16d14f593ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:05.195224 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-23b02426-0f90-4b17-9f39-c16d14f593ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:05.195774 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-23b02426-0f90-4b17-9f39-c16d14f593ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:05.196748 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-23b02426-0f90-4b17-9f39-c16d14f593ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:05.197282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-23b02426-0f90-4b17-9f39-c16d14f593ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:05.332643 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-23b02426-0f90-4b17-9f39-c16d14f593ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:05.340748 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-23b02426-0f90-4b17-9f39-c16d14f593ee tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.160503 Jun 28 03:30:05.341311 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 506/1019] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:05 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:06.362850 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b13236b0-94ab-4c01-a314-f1b12c3df9e0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:06.363542 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b13236b0-94ab-4c01-a314-f1b12c3df9e0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:06.373126 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b13236b0-94ab-4c01-a314-f1b12c3df9e0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:06.373570 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b13236b0-94ab-4c01-a314-f1b12c3df9e0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:06.374326 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b13236b0-94ab-4c01-a314-f1b12c3df9e0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:06.374766 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b13236b0-94ab-4c01-a314-f1b12c3df9e0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:06.515431 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b13236b0-94ab-4c01-a314-f1b12c3df9e0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:06.523556 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b13236b0-94ab-4c01-a314-f1b12c3df9e0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.167535 Jun 28 03:30:06.524145 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 514/1020] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:06 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:07.544483 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c735fa38-cdbb-47ca-bda8-ccd0b80e5d2f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:07.545241 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c735fa38-cdbb-47ca-bda8-ccd0b80e5d2f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:07.555293 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c735fa38-cdbb-47ca-bda8-ccd0b80e5d2f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:07.555899 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c735fa38-cdbb-47ca-bda8-ccd0b80e5d2f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:07.556969 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c735fa38-cdbb-47ca-bda8-ccd0b80e5d2f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:07.557549 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c735fa38-cdbb-47ca-bda8-ccd0b80e5d2f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:07.704726 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c735fa38-cdbb-47ca-bda8-ccd0b80e5d2f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:07.715972 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c735fa38-cdbb-47ca-bda8-ccd0b80e5d2f tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.177871 Jun 28 03:30:07.716614 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 507/1021] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:07 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:08.733674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-767c082c-d1ac-4316-8a65-38cf57e8d82b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:08.735322 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-767c082c-d1ac-4316-8a65-38cf57e8d82b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:08.744687 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-767c082c-d1ac-4316-8a65-38cf57e8d82b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:08.745384 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-767c082c-d1ac-4316-8a65-38cf57e8d82b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:08.746640 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-767c082c-d1ac-4316-8a65-38cf57e8d82b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:08.747067 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-767c082c-d1ac-4316-8a65-38cf57e8d82b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:08.886477 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-767c082c-d1ac-4316-8a65-38cf57e8d82b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:08.894544 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-767c082c-d1ac-4316-8a65-38cf57e8d82b tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1267 microversion: 2.1 time: 0.164943 Jun 28 03:30:08.895109 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 515/1022] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:08 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:09.911169 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-bb5546e5-6de7-42ba-b0d1-45f47272dfb7 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:09.911738 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-bb5546e5-6de7-42ba-b0d1-45f47272dfb7 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:09.918910 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bb5546e5-6de7-42ba-b0d1-45f47272dfb7 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:09.919377 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bb5546e5-6de7-42ba-b0d1-45f47272dfb7 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:09.920209 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bb5546e5-6de7-42ba-b0d1-45f47272dfb7 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:09.920602 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-bb5546e5-6de7-42ba-b0d1-45f47272dfb7 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:10.067020 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-bb5546e5-6de7-42ba-b0d1-45f47272dfb7 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:10.077472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-bb5546e5-6de7-42ba-b0d1-45f47272dfb7 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1453 microversion: 2.1 time: 0.170249 Jun 28 03:30:10.078062 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 508/1023] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:09 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:10.094840 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b3272ada-377a-4e24-a569-a320e083a045 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:10.095407 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b3272ada-377a-4e24-a569-a320e083a045 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:10.102987 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b3272ada-377a-4e24-a569-a320e083a045 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:10.103410 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b3272ada-377a-4e24-a569-a320e083a045 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:10.104214 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b3272ada-377a-4e24-a569-a320e083a045 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:10.104657 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b3272ada-377a-4e24-a569-a320e083a045 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:10.247466 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b3272ada-377a-4e24-a569-a320e083a045 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:10.255505 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b3272ada-377a-4e24-a569-a320e083a045 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1453 microversion: 2.1 time: 0.165079 Jun 28 03:30:10.256004 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 516/1024] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:10 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:12.214859 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-e08bb292-35b3-4e69-ac6a-8cb902e30a09 req-4549ae90-6083-455f-982b-eb0019090b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2af0949-b2f6-49e1-add2-7d85b03ea3ee", "tag": "f43b1e9e-3571-489a-8a6f-25c327d5fa89"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:30:12.223279 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-e08bb292-35b3-4e69-ac6a-8cb902e30a09 req-4549ae90-6083-455f-982b-eb0019090b77 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:12.224011 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-e08bb292-35b3-4e69-ac6a-8cb902e30a09 req-4549ae90-6083-455f-982b-eb0019090b77 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:12.235197 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-e08bb292-35b3-4e69-ac6a-8cb902e30a09 req-4549ae90-6083-455f-982b-eb0019090b77 service nova] Creating event network-changed:f43b1e9e-3571-489a-8a6f-25c327d5fa89 for instance a2af0949-b2f6-49e1-add2-7d85b03ea3ee on hv-cinder-84684 Jun 28 03:30:12.240282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-e08bb292-35b3-4e69-ac6a-8cb902e30a09 req-4549ae90-6083-455f-982b-eb0019090b77 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097183 Jun 28 03:30:12.240882 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 509/1025] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:30:36.922394 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1318161087", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "networks": [{"uuid": "e51bb004-dde2-4a7b-8ee5-f589f2789d17"}]}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:30:36.930707 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:30:36.931364 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=54 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:30:36.977809 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] validate_networks() for [('e51bb004-dde2-4a7b-8ee5-f589f2789d17', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:30:37.328612 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:30:37.329032 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:30:37.329496 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:30:37.329895 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:30:37.330297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:30:37.341132 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:37.341501 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:37.342282 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:37.342879 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:37.360751 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Getting quotas for project 10b8b4e2041e41dc8716272d68867537. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:30:37.364877 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Getting quotas for user 4fb857949a344cc99dd6a2f9a5e64152 and project 10b8b4e2041e41dc8716272d68867537. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:30:37.375883 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:30:37.378167 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:30:37.424301 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-803a94df-0803-41fd-9175-c2e136270234 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505726 Jun 28 03:30:37.428237 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 517/1026] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:30:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:30:37.433218 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=24 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:30:37.434010 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=57 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:30:37.438876 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-dedc3682-7b43-49ee-9217-30543a1c91a3 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:37.439573 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-dedc3682-7b43-49ee-9217-30543a1c91a3 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:37.499425 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-dedc3682-7b43-49ee-9217-30543a1c91a3 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:37.509801 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-dedc3682-7b43-49ee-9217-30543a1c91a3 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 200 len: 1219 microversion: 2.1 time: 0.078453 Jun 28 03:30:37.510398 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 510/1027] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:37 2022] GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:38.527822 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-80566675-ad9d-42cc-9d8c-142a981bca8a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:38.529274 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-80566675-ad9d-42cc-9d8c-142a981bca8a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:38.538316 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-80566675-ad9d-42cc-9d8c-142a981bca8a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:38.538732 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-80566675-ad9d-42cc-9d8c-142a981bca8a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:38.540631 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-80566675-ad9d-42cc-9d8c-142a981bca8a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:38.541302 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-80566675-ad9d-42cc-9d8c-142a981bca8a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:38.618047 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-80566675-ad9d-42cc-9d8c-142a981bca8a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:38.628723 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-80566675-ad9d-42cc-9d8c-142a981bca8a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 200 len: 1289 microversion: 2.1 time: 0.105654 Jun 28 03:30:38.632239 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 518/1028] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:38 2022] GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 1289 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:39.648075 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-c7f5159f-b5ba-4c8e-a483-0957d167f2f6 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:39.648720 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-c7f5159f-b5ba-4c8e-a483-0957d167f2f6 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:39.657507 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7f5159f-b5ba-4c8e-a483-0957d167f2f6 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:39.657937 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7f5159f-b5ba-4c8e-a483-0957d167f2f6 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:39.659047 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7f5159f-b5ba-4c8e-a483-0957d167f2f6 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:39.660414 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-c7f5159f-b5ba-4c8e-a483-0957d167f2f6 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:39.831034 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-c7f5159f-b5ba-4c8e-a483-0957d167f2f6 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:39.840017 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-c7f5159f-b5ba-4c8e-a483-0957d167f2f6 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 200 len: 1319 microversion: 2.1 time: 0.196667 Jun 28 03:30:39.840732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 511/1029] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:39 2022] GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:39.968040 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-7d61e3fe-e738-4e7c-a465-74530cb8df68 req-0cfefba6-10a1-4d6b-b2d7-57ffff005783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "858f9d82-c180-4cba-a886-28ada38304c3", "tag": "2dfd51df-f095-44aa-b3c9-e5e88f033a9b"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:30:39.984960 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-7d61e3fe-e738-4e7c-a465-74530cb8df68 req-0cfefba6-10a1-4d6b-b2d7-57ffff005783 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:39.985405 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-7d61e3fe-e738-4e7c-a465-74530cb8df68 req-0cfefba6-10a1-4d6b-b2d7-57ffff005783 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:39.999842 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-7d61e3fe-e738-4e7c-a465-74530cb8df68 req-0cfefba6-10a1-4d6b-b2d7-57ffff005783 service nova] Creating event network-changed:2dfd51df-f095-44aa-b3c9-e5e88f033a9b for instance 858f9d82-c180-4cba-a886-28ada38304c3 on hv-cinder-84684 Jun 28 03:30:40.005025 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-7d61e3fe-e738-4e7c-a465-74530cb8df68 req-0cfefba6-10a1-4d6b-b2d7-57ffff005783 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043556 Jun 28 03:30:40.006109 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 519/1030] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:30:40.858704 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-985a61e7-8bb0-41f4-8626-2e6a3acce58e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:40.859242 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-985a61e7-8bb0-41f4-8626-2e6a3acce58e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:40.866129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-985a61e7-8bb0-41f4-8626-2e6a3acce58e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:40.866578 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-985a61e7-8bb0-41f4-8626-2e6a3acce58e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:40.867342 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-985a61e7-8bb0-41f4-8626-2e6a3acce58e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:40.868455 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-985a61e7-8bb0-41f4-8626-2e6a3acce58e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:41.005677 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-985a61e7-8bb0-41f4-8626-2e6a3acce58e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:41.013630 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-985a61e7-8bb0-41f4-8626-2e6a3acce58e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 200 len: 1319 microversion: 2.1 time: 0.158948 Jun 28 03:30:41.014539 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 512/1031] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:40 2022] GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:42.031806 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8231cea9-d32a-4773-b281-689e040e936a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:42.032433 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8231cea9-d32a-4773-b281-689e040e936a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:42.039155 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8231cea9-d32a-4773-b281-689e040e936a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:42.039591 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8231cea9-d32a-4773-b281-689e040e936a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:42.040377 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8231cea9-d32a-4773-b281-689e040e936a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:42.040803 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8231cea9-d32a-4773-b281-689e040e936a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:42.177081 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8231cea9-d32a-4773-b281-689e040e936a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:42.185246 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8231cea9-d32a-4773-b281-689e040e936a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 200 len: 1319 microversion: 2.1 time: 0.158241 Jun 28 03:30:42.185826 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 520/1032] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:42 2022] GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:43.202506 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-02ee151f-6cce-45b5-8977-8e5742444f58 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:43.203071 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-02ee151f-6cce-45b5-8977-8e5742444f58 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:43.209658 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-02ee151f-6cce-45b5-8977-8e5742444f58 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:43.210097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-02ee151f-6cce-45b5-8977-8e5742444f58 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:43.210844 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-02ee151f-6cce-45b5-8977-8e5742444f58 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:43.211271 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-02ee151f-6cce-45b5-8977-8e5742444f58 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:43.344682 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-02ee151f-6cce-45b5-8977-8e5742444f58 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:43.352574 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-02ee151f-6cce-45b5-8977-8e5742444f58 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 200 len: 1319 microversion: 2.1 time: 0.153908 Jun 28 03:30:43.353129 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 513/1033] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:43 2022] GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:44.371456 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fa816b5e-1244-48ca-bf96-277f4cbf8f62 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:44.372034 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fa816b5e-1244-48ca-bf96-277f4cbf8f62 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:44.379211 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa816b5e-1244-48ca-bf96-277f4cbf8f62 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:44.379652 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa816b5e-1244-48ca-bf96-277f4cbf8f62 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:44.380438 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa816b5e-1244-48ca-bf96-277f4cbf8f62 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:44.380860 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa816b5e-1244-48ca-bf96-277f4cbf8f62 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:44.518163 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fa816b5e-1244-48ca-bf96-277f4cbf8f62 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:44.526434 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fa816b5e-1244-48ca-bf96-277f4cbf8f62 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 200 len: 1319 microversion: 2.1 time: 0.159501 Jun 28 03:30:44.527004 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 521/1034] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:44 2022] GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:44.612054 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-874bfcff-abad-4045-afb7-7c6299e220c9 req-4e44708d-90b9-4755-8008-d20c73bcdfbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858f9d82-c180-4cba-a886-28ada38304c3", "name": "network-vif-plugged", "status": "completed", "tag": "2dfd51df-f095-44aa-b3c9-e5e88f033a9b"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:30:44.621302 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-874bfcff-abad-4045-afb7-7c6299e220c9 req-4e44708d-90b9-4755-8008-d20c73bcdfbd service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:44.621841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-874bfcff-abad-4045-afb7-7c6299e220c9 req-4e44708d-90b9-4755-8008-d20c73bcdfbd service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:44.634826 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-874bfcff-abad-4045-afb7-7c6299e220c9 req-4e44708d-90b9-4755-8008-d20c73bcdfbd service nova] Creating event network-vif-plugged:2dfd51df-f095-44aa-b3c9-e5e88f033a9b for instance 858f9d82-c180-4cba-a886-28ada38304c3 on hv-cinder-84684 Jun 28 03:30:44.640242 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-874bfcff-abad-4045-afb7-7c6299e220c9 req-4e44708d-90b9-4755-8008-d20c73bcdfbd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031805 Jun 28 03:30:44.640860 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 514/1035] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:30:45.543514 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ce700d92-f853-42df-bb09-96df831c98dd tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:45.544114 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ce700d92-f853-42df-bb09-96df831c98dd tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:45.551286 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce700d92-f853-42df-bb09-96df831c98dd tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:45.551807 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce700d92-f853-42df-bb09-96df831c98dd tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:45.552685 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce700d92-f853-42df-bb09-96df831c98dd tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:45.553330 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce700d92-f853-42df-bb09-96df831c98dd tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:45.689989 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ce700d92-f853-42df-bb09-96df831c98dd tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:45.699191 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ce700d92-f853-42df-bb09-96df831c98dd tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 200 len: 1319 microversion: 2.1 time: 0.159574 Jun 28 03:30:45.699990 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 522/1036] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:45 2022] GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:30:46.727472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6b9bafd6-bfad-4043-8e68-f5d4cae4d43c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:30:46.729113 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6b9bafd6-bfad-4043-8e68-f5d4cae4d43c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:30:46.739955 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6b9bafd6-bfad-4043-8e68-f5d4cae4d43c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:46.740768 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6b9bafd6-bfad-4043-8e68-f5d4cae4d43c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:46.742039 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6b9bafd6-bfad-4043-8e68-f5d4cae4d43c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:30:46.742769 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6b9bafd6-bfad-4043-8e68-f5d4cae4d43c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:30:46.873171 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6b9bafd6-bfad-4043-8e68-f5d4cae4d43c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:30:46.880915 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6b9bafd6-bfad-4043-8e68-f5d4cae4d43c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 200 len: 1508 microversion: 2.1 time: 0.161796 Jun 28 03:30:46.881482 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 515/1037] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:30:46 2022] GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:03.133176 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fde652cf-51d8-47d1-9572-ab055c7ede81 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04ca8329-5633-4f0e-8fea-bb0524cfd8e8", "device": "/dev/sdb"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:31:03.134756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fde652cf-51d8-47d1-9572-ab055c7ede81 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:03.136941 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:03.137634 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:03.138329 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:03.138960 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=28 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:03.145003 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fde652cf-51d8-47d1-9572-ab055c7ede81 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:03.145458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fde652cf-51d8-47d1-9572-ab055c7ede81 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:03.146224 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fde652cf-51d8-47d1-9572-ab055c7ede81 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:03.146658 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fde652cf-51d8-47d1-9572-ab055c7ede81 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:03.414176 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fde652cf-51d8-47d1-9572-ab055c7ede81 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "POST /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284885 Jun 28 03:31:03.414794 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 523/1038] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:31:03 2022] POST /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:31:26.264460 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-14aaca61-9a55-4b80-a6d8-da0f3f6161a1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:26.265032 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-14aaca61-9a55-4b80-a6d8-da0f3f6161a1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:26.267005 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:26.267727 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=14 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:26.268387 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=26 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:26.274067 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-14aaca61-9a55-4b80-a6d8-da0f3f6161a1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:26.274517 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-14aaca61-9a55-4b80-a6d8-da0f3f6161a1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:26.275278 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-14aaca61-9a55-4b80-a6d8-da0f3f6161a1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:26.275688 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-14aaca61-9a55-4b80-a6d8-da0f3f6161a1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:26.358846 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.objects.instance [None req-14aaca61-9a55-4b80-a6d8-da0f3f6161a1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lazy-loading 'services' on Instance uuid 858f9d82-c180-4cba-a886-28ada38304c3 {{(pid=117681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:31:26.440632 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-14aaca61-9a55-4b80-a6d8-da0f3f6161a1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "DELETE /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3/os-volume_attachments/04ca8329-5633-4f0e-8fea-bb0524cfd8e8" status: 202 len: 0 microversion: 2.1 time: 0.180206 Jun 28 03:31:26.441212 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 516/1039] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 28 03:31:26 2022] DELETE /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3/os-volume_attachments/04ca8329-5633-4f0e-8fea-bb0524cfd8e8 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:31:27.562955 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:27.563683 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:27.567817 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d64085ff-ebcf-41ed-a923-02bb804b6895 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:27.568396 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d64085ff-ebcf-41ed-a923-02bb804b6895 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:27.576899 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d64085ff-ebcf-41ed-a923-02bb804b6895 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:27.577336 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d64085ff-ebcf-41ed-a923-02bb804b6895 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:27.578095 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d64085ff-ebcf-41ed-a923-02bb804b6895 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:27.578522 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d64085ff-ebcf-41ed-a923-02bb804b6895 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:27.604087 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d64085ff-ebcf-41ed-a923-02bb804b6895 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:31:27.688893 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d64085ff-ebcf-41ed-a923-02bb804b6895 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "DELETE /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 204 len: 0 microversion: 2.1 time: 0.127145 Jun 28 03:31:27.689607 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 524/1040] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:31:27 2022] DELETE /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:31:27.698387 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-18e1dfd7-ac4f-4f07-a171-d9eaf517f70a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:27.699218 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-18e1dfd7-ac4f-4f07-a171-d9eaf517f70a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:27.706237 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-18e1dfd7-ac4f-4f07-a171-d9eaf517f70a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:27.706678 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-18e1dfd7-ac4f-4f07-a171-d9eaf517f70a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:27.707423 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-18e1dfd7-ac4f-4f07-a171-d9eaf517f70a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:27.707851 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-18e1dfd7-ac4f-4f07-a171-d9eaf517f70a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:27.850979 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-18e1dfd7-ac4f-4f07-a171-d9eaf517f70a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:27.855160 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-18e1dfd7-ac4f-4f07-a171-d9eaf517f70a tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 200 len: 1514 microversion: 2.1 time: 0.160956 Jun 28 03:31:27.855725 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 517/1041] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:27 2022] GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:28.877147 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-698cd1d5-2856-42cf-aba4-659b2e814ab1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:28.878295 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-698cd1d5-2856-42cf-aba4-659b2e814ab1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:28.888343 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-698cd1d5-2856-42cf-aba4-659b2e814ab1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:28.888788 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-698cd1d5-2856-42cf-aba4-659b2e814ab1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:28.889541 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-698cd1d5-2856-42cf-aba4-659b2e814ab1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:28.889972 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-698cd1d5-2856-42cf-aba4-659b2e814ab1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:29.034812 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-698cd1d5-2856-42cf-aba4-659b2e814ab1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:29.042920 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-698cd1d5-2856-42cf-aba4-659b2e814ab1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 200 len: 1514 microversion: 2.1 time: 0.172783 Jun 28 03:31:29.043548 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 525/1042] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:28 2022] GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:29.926756 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-6995e6ae-e962-4462-9051-a9120ac1a911 req-d6d7cafe-adfa-488c-938d-de9ef22045db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858f9d82-c180-4cba-a886-28ada38304c3", "name": "network-vif-deleted", "tag": "2dfd51df-f095-44aa-b3c9-e5e88f033a9b"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:31:29.935841 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-6995e6ae-e962-4462-9051-a9120ac1a911 req-d6d7cafe-adfa-488c-938d-de9ef22045db service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:29.936307 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-6995e6ae-e962-4462-9051-a9120ac1a911 req-d6d7cafe-adfa-488c-938d-de9ef22045db service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:29.947398 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-6995e6ae-e962-4462-9051-a9120ac1a911 req-d6d7cafe-adfa-488c-938d-de9ef22045db service nova] Creating event network-vif-deleted:2dfd51df-f095-44aa-b3c9-e5e88f033a9b for instance 858f9d82-c180-4cba-a886-28ada38304c3 on hv-cinder-84684 Jun 28 03:31:29.952912 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-6995e6ae-e962-4462-9051-a9120ac1a911 req-d6d7cafe-adfa-488c-938d-de9ef22045db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029514 Jun 28 03:31:29.953884 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 518/1043] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:31:30.066035 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a3591957-20e3-44c4-8722-a530878d08bf tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:30.066648 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a3591957-20e3-44c4-8722-a530878d08bf tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:30.074842 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3591957-20e3-44c4-8722-a530878d08bf tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:30.075267 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3591957-20e3-44c4-8722-a530878d08bf tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:30.076024 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3591957-20e3-44c4-8722-a530878d08bf tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:30.076485 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3591957-20e3-44c4-8722-a530878d08bf tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:30.109883 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3591957-20e3-44c4-8722-a530878d08bf tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:30.110331 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3591957-20e3-44c4-8722-a530878d08bf tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:30.110775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-a3591957-20e3-44c4-8722-a530878d08bf tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lazy-loading 'fault' on Instance uuid 858f9d82-c180-4cba-a886-28ada38304c3 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:31:30.151980 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a3591957-20e3-44c4-8722-a530878d08bf tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:30.159682 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a3591957-20e3-44c4-8722-a530878d08bf tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 200 len: 1309 microversion: 2.1 time: 0.098892 Jun 28 03:31:30.160511 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 526/1044] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:30 2022] GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:31.183955 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-dcc0b853-0bd0-4154-8fbe-3cec55191f95 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:31.184676 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-dcc0b853-0bd0-4154-8fbe-3cec55191f95 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 858f9d82-c180-4cba-a886-28ada38304c3] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:31.192095 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dcc0b853-0bd0-4154-8fbe-3cec55191f95 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:31.192636 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dcc0b853-0bd0-4154-8fbe-3cec55191f95 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:31.193382 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dcc0b853-0bd0-4154-8fbe-3cec55191f95 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:31.193809 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-dcc0b853-0bd0-4154-8fbe-3cec55191f95 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:31.207640 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-dcc0b853-0bd0-4154-8fbe-3cec55191f95 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] HTTP exception thrown: Instance 858f9d82-c180-4cba-a886-28ada38304c3 could not be found. Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-dcc0b853-0bd0-4154-8fbe-3cec55191f95 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Request method failure captured: Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 HTTP/1.1 Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunXb5JymarbS0kFflAhajWNne7PfDRLPha-5AmvfY7eruNHrG21e_nnK7Ur54eSqiEVcq5kEgRPCFSfL07YP4CmqEJzJ_UXmC_s_1TFRnqCMKdBRMZ3tgRiIwSctsZV6XEWiz0PBG6qn_ap1JZi4nHLhkuNm-7RhLd1V6YKDhI9ygfg Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 10b8b4e2041e41dc8716272d68867537 Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1032863486 Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:31:31.209282 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:31:31.210885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_10b8b4e2041e41dc8716272d68867537", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/10b8b4e2041e41dc8716272d68867537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/10b8b4e2041e41dc8716272d68867537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/10b8b4e2041e41dc8716272d68867537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:31:31.210885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-VolumesSnapshotTestJSON-1032863486 Jun 28 03:31:31.210885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 10b8b4e2041e41dc8716272d68867537 Jun 28 03:31:31.210885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1032863486 Jun 28 03:31:31.210885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-VolumesSnapshotTestJSON-1032863486-project Jun 28 03:31:31.210885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:31:31.210885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:31:31.210885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4fb857949a344cc99dd6a2f9a5e64152 Jun 28 03:31:31.210885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-VolumesSnapshotTestJSON-1032863486-project Jun 28 03:31:31.210885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:31:31.210885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 858f9d82-c180-4cba-a886-28ada38304c3 could not be found. Jun 28 03:31:31.210885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '858f9d82-c180-4cba-a886-28ada38304c3'} Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 858f9d82-c180-4cba-a886-28ada38304c3 could not be found. Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:31:31.211831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 858f9d82-c180-4cba-a886-28ada38304c3 could not be found. Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 858f9d82-c180-4cba-a886-28ada38304c3 could not be found. Jun 28 03:31:31.213464 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:31:31.215149 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-dcc0b853-0bd0-4154-8fbe-3cec55191f95 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Returning 404 to user: Instance 858f9d82-c180-4cba-a886-28ada38304c3 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:31:31.215149 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-dcc0b853-0bd0-4154-8fbe-3cec55191f95 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3" status: 404 len: 111 microversion: 2.1 time: 0.032523 Jun 28 03:31:31.215149 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 519/1045] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:31 2022] GET /compute/v2.1/servers/858f9d82-c180-4cba-a886-28ada38304c3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:31:39.061297 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1168088504", "imageRef": "db670328-7949-4b8b-b60b-b5f822442749", "flavorRef": "452", "networks": [{"uuid": "e51bb004-dde2-4a7b-8ee5-f589f2789d17"}]}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:31:39.126193 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] validate_networks() for [('e51bb004-dde2-4a7b-8ee5-f589f2789d17', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 28 03:31:39.556965 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 28 03:31:39.557528 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 28 03:31:39.558278 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 28 03:31:39.558852 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 28 03:31:39.559381 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 28 03:31:39.569351 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:39.569785 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:39.570562 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:39.570986 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:39.589047 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Getting quotas for project 10b8b4e2041e41dc8716272d68867537. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 28 03:31:39.593983 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Getting quotas for user 4fb857949a344cc99dd6a2f9a5e64152 and project 10b8b4e2041e41dc8716272d68867537. Resources: {'instances', 'ram', 'cores'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 28 03:31:39.606042 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 28 03:31:39.608699 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db670328-7949-4b8b-b60b-b5f822442749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 28 03:31:39.661820 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a2413740-3d27-4512-9708-1eb0cd2e4e6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606280 Jun 28 03:31:39.662465 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 527/1046] 10.222.0.44 () {60 vars in 1146 bytes} [Tue Jun 28 03:31:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 28 03:31:39.672820 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-3d234c7b-808b-4774-a9da-4dc6c70dcd39 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:39.673563 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-3d234c7b-808b-4774-a9da-4dc6c70dcd39 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:39.729770 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-3d234c7b-808b-4774-a9da-4dc6c70dcd39 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:39.740111 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-3d234c7b-808b-4774-a9da-4dc6c70dcd39 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1219 microversion: 2.1 time: 0.071336 Jun 28 03:31:39.745644 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 520/1047] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:39 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:40.757713 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-472aefcb-225c-4f4a-9f06-8c2caa1df2e1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:40.758428 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-472aefcb-225c-4f4a-9f06-8c2caa1df2e1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:40.767248 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-472aefcb-225c-4f4a-9f06-8c2caa1df2e1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:40.767764 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-472aefcb-225c-4f4a-9f06-8c2caa1df2e1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:40.768824 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-472aefcb-225c-4f4a-9f06-8c2caa1df2e1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:40.769009 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-472aefcb-225c-4f4a-9f06-8c2caa1df2e1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:40.847693 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-472aefcb-225c-4f4a-9f06-8c2caa1df2e1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:40.855705 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-472aefcb-225c-4f4a-9f06-8c2caa1df2e1 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1277 microversion: 2.1 time: 0.102243 Jun 28 03:31:40.856439 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 528/1048] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:40 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:41.877073 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-1627926c-2b3b-426e-a6ca-01d013cadb6d tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:41.877660 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-1627926c-2b3b-426e-a6ca-01d013cadb6d tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:41.880709 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:41.886711 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1627926c-2b3b-426e-a6ca-01d013cadb6d tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:41.887153 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1627926c-2b3b-426e-a6ca-01d013cadb6d tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:41.887908 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1627926c-2b3b-426e-a6ca-01d013cadb6d tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:41.888363 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-1627926c-2b3b-426e-a6ca-01d013cadb6d tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:41.980657 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-be556a84-520b-4b8f-86f9-b6bb2816a259 req-aec200d1-8ad2-4312-8103-5a0db8d5c58f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fe2c31b-d667-452d-afc4-ab061d459781", "tag": "40fa138e-e74f-4334-951f-6f55161d50e3"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:31:41.994386 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-be556a84-520b-4b8f-86f9-b6bb2816a259 req-aec200d1-8ad2-4312-8103-5a0db8d5c58f service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:41.994888 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-be556a84-520b-4b8f-86f9-b6bb2816a259 req-aec200d1-8ad2-4312-8103-5a0db8d5c58f service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:42.006597 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-be556a84-520b-4b8f-86f9-b6bb2816a259 req-aec200d1-8ad2-4312-8103-5a0db8d5c58f service nova] Creating event network-changed:40fa138e-e74f-4334-951f-6f55161d50e3 for instance 0fe2c31b-d667-452d-afc4-ab061d459781 on hv-cinder-84684 Jun 28 03:31:42.011449 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-be556a84-520b-4b8f-86f9-b6bb2816a259 req-aec200d1-8ad2-4312-8103-5a0db8d5c58f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042461 Jun 28 03:31:42.012247 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 529/1049] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:31:42.035948 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-1627926c-2b3b-426e-a6ca-01d013cadb6d tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:42.043472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-1627926c-2b3b-426e-a6ca-01d013cadb6d tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1319 microversion: 2.1 time: 0.170373 Jun 28 03:31:42.044032 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 521/1050] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:41 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:43.066517 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-40ae5bbd-5254-4004-99ca-36da20c982fb tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:43.067430 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-40ae5bbd-5254-4004-99ca-36da20c982fb tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:43.078321 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-40ae5bbd-5254-4004-99ca-36da20c982fb tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:43.079076 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-40ae5bbd-5254-4004-99ca-36da20c982fb tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:43.079861 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-40ae5bbd-5254-4004-99ca-36da20c982fb tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:43.080311 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-40ae5bbd-5254-4004-99ca-36da20c982fb tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:43.218517 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-40ae5bbd-5254-4004-99ca-36da20c982fb tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:43.226756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-40ae5bbd-5254-4004-99ca-36da20c982fb tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1319 microversion: 2.1 time: 0.168645 Jun 28 03:31:43.227320 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 530/1051] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:43 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:44.257043 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-08a5be19-34e6-4955-bc9f-30631eb9ac14 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:44.257740 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-08a5be19-34e6-4955-bc9f-30631eb9ac14 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:44.265727 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-08a5be19-34e6-4955-bc9f-30631eb9ac14 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:44.266250 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-08a5be19-34e6-4955-bc9f-30631eb9ac14 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:44.267137 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-08a5be19-34e6-4955-bc9f-30631eb9ac14 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:44.267638 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-08a5be19-34e6-4955-bc9f-30631eb9ac14 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:44.407040 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-08a5be19-34e6-4955-bc9f-30631eb9ac14 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:44.415406 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-08a5be19-34e6-4955-bc9f-30631eb9ac14 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1319 microversion: 2.1 time: 0.162982 Jun 28 03:31:44.415976 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 522/1052] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:44 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:45.436218 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5fa69682-c3d8-48db-80db-f676c29c240b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:45.437286 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5fa69682-c3d8-48db-80db-f676c29c240b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:45.448401 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5fa69682-c3d8-48db-80db-f676c29c240b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:45.449144 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5fa69682-c3d8-48db-80db-f676c29c240b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:45.450397 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5fa69682-c3d8-48db-80db-f676c29c240b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:45.451113 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5fa69682-c3d8-48db-80db-f676c29c240b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:45.581336 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5fa69682-c3d8-48db-80db-f676c29c240b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:45.589231 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5fa69682-c3d8-48db-80db-f676c29c240b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1319 microversion: 2.1 time: 0.159596 Jun 28 03:31:45.589773 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 531/1053] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:45 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:46.609880 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-50eca27f-e348-481d-95d5-2cb1eb1b5003 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:46.610725 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-50eca27f-e348-481d-95d5-2cb1eb1b5003 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:46.619913 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-50eca27f-e348-481d-95d5-2cb1eb1b5003 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:46.620551 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-50eca27f-e348-481d-95d5-2cb1eb1b5003 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:46.621655 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-50eca27f-e348-481d-95d5-2cb1eb1b5003 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:46.622225 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-50eca27f-e348-481d-95d5-2cb1eb1b5003 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:46.762941 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-50eca27f-e348-481d-95d5-2cb1eb1b5003 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:46.770666 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-50eca27f-e348-481d-95d5-2cb1eb1b5003 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1319 microversion: 2.1 time: 0.167169 Jun 28 03:31:46.771248 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 523/1054] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:46 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:47.790221 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a3eaaf27-dfca-44e6-bde3-7de8a758183c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:47.790858 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a3eaaf27-dfca-44e6-bde3-7de8a758183c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:47.797862 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3eaaf27-dfca-44e6-bde3-7de8a758183c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:47.798589 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3eaaf27-dfca-44e6-bde3-7de8a758183c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:47.799680 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3eaaf27-dfca-44e6-bde3-7de8a758183c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:47.800381 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3eaaf27-dfca-44e6-bde3-7de8a758183c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:47.945811 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a3eaaf27-dfca-44e6-bde3-7de8a758183c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:47.953496 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a3eaaf27-dfca-44e6-bde3-7de8a758183c tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1319 microversion: 2.1 time: 0.169026 Jun 28 03:31:47.954279 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 532/1055] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:47 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:48.911723 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-ba3a7e52-893c-4271-849d-c9dcc63fa0da req-8d55afb4-65c9-4088-b3b6-97c2e7dbe079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe2c31b-d667-452d-afc4-ab061d459781", "name": "network-vif-plugged", "status": "completed", "tag": "40fa138e-e74f-4334-951f-6f55161d50e3"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:31:48.923109 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-ba3a7e52-893c-4271-849d-c9dcc63fa0da req-8d55afb4-65c9-4088-b3b6-97c2e7dbe079 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:48.923542 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-ba3a7e52-893c-4271-849d-c9dcc63fa0da req-8d55afb4-65c9-4088-b3b6-97c2e7dbe079 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:48.936662 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-ba3a7e52-893c-4271-849d-c9dcc63fa0da req-8d55afb4-65c9-4088-b3b6-97c2e7dbe079 service nova] Creating event network-vif-plugged:40fa138e-e74f-4334-951f-6f55161d50e3 for instance 0fe2c31b-d667-452d-afc4-ab061d459781 on hv-cinder-84684 Jun 28 03:31:48.942092 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-ba3a7e52-893c-4271-849d-c9dcc63fa0da req-8d55afb4-65c9-4088-b3b6-97c2e7dbe079 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034272 Jun 28 03:31:48.942717 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 524/1056] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:31:48.970628 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3ac7cd30-c7fd-4aae-8e45-8b70bba9c536 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:48.971241 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3ac7cd30-c7fd-4aae-8e45-8b70bba9c536 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:48.978984 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ac7cd30-c7fd-4aae-8e45-8b70bba9c536 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:48.979605 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ac7cd30-c7fd-4aae-8e45-8b70bba9c536 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:48.980470 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ac7cd30-c7fd-4aae-8e45-8b70bba9c536 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:48.980873 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ac7cd30-c7fd-4aae-8e45-8b70bba9c536 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:49.116474 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3ac7cd30-c7fd-4aae-8e45-8b70bba9c536 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:49.124579 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3ac7cd30-c7fd-4aae-8e45-8b70bba9c536 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1319 microversion: 2.1 time: 0.157883 Jun 28 03:31:49.125153 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 533/1057] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:48 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:50.147242 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-d3a55926-c7d7-4c57-9376-befbe5fcd7d5 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:50.148422 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-d3a55926-c7d7-4c57-9376-befbe5fcd7d5 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:50.151921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell0:SELECT=2 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:50.160833 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d3a55926-c7d7-4c57-9376-befbe5fcd7d5 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:50.161289 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d3a55926-c7d7-4c57-9376-befbe5fcd7d5 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:50.162041 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d3a55926-c7d7-4c57-9376-befbe5fcd7d5 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:50.162472 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-d3a55926-c7d7-4c57-9376-befbe5fcd7d5 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:50.305640 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-d3a55926-c7d7-4c57-9376-befbe5fcd7d5 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:50.313177 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-d3a55926-c7d7-4c57-9376-befbe5fcd7d5 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1319 microversion: 2.1 time: 0.172993 Jun 28 03:31:50.313741 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 525/1058] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:50 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:51.332544 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6670029c-5a40-4621-b2bc-39a8b7df1fac tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:51.333124 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6670029c-5a40-4621-b2bc-39a8b7df1fac tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:51.335058 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:51.335756 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:51.341468 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6670029c-5a40-4621-b2bc-39a8b7df1fac tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:51.341910 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6670029c-5a40-4621-b2bc-39a8b7df1fac tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:51.342674 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6670029c-5a40-4621-b2bc-39a8b7df1fac tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:51.343099 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6670029c-5a40-4621-b2bc-39a8b7df1fac tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:51.474034 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6670029c-5a40-4621-b2bc-39a8b7df1fac tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:51.482582 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6670029c-5a40-4621-b2bc-39a8b7df1fac tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1508 microversion: 2.1 time: 0.155500 Jun 28 03:31:51.483206 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 534/1059] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:51 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:51.499582 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-e0e56cfc-48ca-4a8d-ace5-1ceec4c7d9ce tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aae080ea-f2d1-43db-a970-003527f58efb", "device": "/dev/sdb"}} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:31:51.501171 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-e0e56cfc-48ca-4a8d-ace5-1ceec4c7d9ce tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:51.507938 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e0e56cfc-48ca-4a8d-ace5-1ceec4c7d9ce tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:51.508403 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e0e56cfc-48ca-4a8d-ace5-1ceec4c7d9ce tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:51.509174 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e0e56cfc-48ca-4a8d-ace5-1ceec4c7d9ce tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:51.509599 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-e0e56cfc-48ca-4a8d-ace5-1ceec4c7d9ce tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:51.770859 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-e0e56cfc-48ca-4a8d-ace5-1ceec4c7d9ce tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "POST /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275191 Jun 28 03:31:51.771468 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 526/1060] 10.222.0.44 () {60 vars in 1322 bytes} [Tue Jun 28 03:31:51 2022] POST /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:31:51.993048 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-991a6613-5b42-41f5-8dc6-4598cc3a63b0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:51.993536 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-991a6613-5b42-41f5-8dc6-4598cc3a63b0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:51.996891 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-5d259a5f-1d54-408f-8619-da74daea007e req-848a32f5-a1d3-4d04-902c-c734c27c4c05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2af0949-b2f6-49e1-add2-7d85b03ea3ee", "tag": "f43b1e9e-3571-489a-8a6f-25c327d5fa89"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:31:52.000061 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-991a6613-5b42-41f5-8dc6-4598cc3a63b0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:52.000891 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-991a6613-5b42-41f5-8dc6-4598cc3a63b0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:52.001802 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-991a6613-5b42-41f5-8dc6-4598cc3a63b0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:52.002306 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-991a6613-5b42-41f5-8dc6-4598cc3a63b0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:52.006805 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-5d259a5f-1d54-408f-8619-da74daea007e req-848a32f5-a1d3-4d04-902c-c734c27c4c05 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:52.007721 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-5d259a5f-1d54-408f-8619-da74daea007e req-848a32f5-a1d3-4d04-902c-c734c27c4c05 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:52.020440 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-5d259a5f-1d54-408f-8619-da74daea007e req-848a32f5-a1d3-4d04-902c-c734c27c4c05 service nova] Creating event network-changed:f43b1e9e-3571-489a-8a6f-25c327d5fa89 for instance a2af0949-b2f6-49e1-add2-7d85b03ea3ee on hv-cinder-84684 Jun 28 03:31:52.025667 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-5d259a5f-1d54-408f-8619-da74daea007e req-848a32f5-a1d3-4d04-902c-c734c27c4c05 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034163 Jun 28 03:31:52.026360 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 527/1061] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:31:52.029236 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-991a6613-5b42-41f5-8dc6-4598cc3a63b0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:31:52.128055 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-991a6613-5b42-41f5-8dc6-4598cc3a63b0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 204 len: 0 microversion: 2.1 time: 0.138312 Jun 28 03:31:52.130027 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 535/1062] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:31:51 2022] DELETE /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:31:52.139553 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-662515fc-1cb6-4fb6-933e-53cd069f1c96 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:52.140537 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-662515fc-1cb6-4fb6-933e-53cd069f1c96 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:52.148060 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-662515fc-1cb6-4fb6-933e-53cd069f1c96 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:52.149290 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-662515fc-1cb6-4fb6-933e-53cd069f1c96 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:52.149564 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-662515fc-1cb6-4fb6-933e-53cd069f1c96 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:52.149997 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-662515fc-1cb6-4fb6-933e-53cd069f1c96 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:52.290413 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-662515fc-1cb6-4fb6-933e-53cd069f1c96 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:52.298469 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-662515fc-1cb6-4fb6-933e-53cd069f1c96 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1577 microversion: 2.1 time: 0.163868 Jun 28 03:31:52.299284 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 528/1063] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:52 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:53.319149 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2c60a159-9afa-482f-b8f1-86842f5e78f6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:53.319836 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2c60a159-9afa-482f-b8f1-86842f5e78f6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:53.326559 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2c60a159-9afa-482f-b8f1-86842f5e78f6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:53.327016 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2c60a159-9afa-482f-b8f1-86842f5e78f6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:53.327762 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2c60a159-9afa-482f-b8f1-86842f5e78f6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:53.328189 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2c60a159-9afa-482f-b8f1-86842f5e78f6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:53.461372 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2c60a159-9afa-482f-b8f1-86842f5e78f6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:53.469124 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2c60a159-9afa-482f-b8f1-86842f5e78f6 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1577 microversion: 2.1 time: 0.154473 Jun 28 03:31:53.469687 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 536/1064] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:53 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:54.487319 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-4482c496-69db-49bc-87f5-e5579d8fcbd0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:54.487921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-4482c496-69db-49bc-87f5-e5579d8fcbd0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:54.494576 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4482c496-69db-49bc-87f5-e5579d8fcbd0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:54.495043 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4482c496-69db-49bc-87f5-e5579d8fcbd0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:54.495823 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4482c496-69db-49bc-87f5-e5579d8fcbd0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:54.496283 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-4482c496-69db-49bc-87f5-e5579d8fcbd0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:54.516282 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-43041547-2479-477a-95cb-1e9d704b7c39 req-ef1a7e55-ee4d-49f0-80af-3151f94b8743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2af0949-b2f6-49e1-add2-7d85b03ea3ee", "name": "network-vif-deleted", "tag": "f43b1e9e-3571-489a-8a6f-25c327d5fa89"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:31:54.525688 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-43041547-2479-477a-95cb-1e9d704b7c39 req-ef1a7e55-ee4d-49f0-80af-3151f94b8743 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:54.526135 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-43041547-2479-477a-95cb-1e9d704b7c39 req-ef1a7e55-ee4d-49f0-80af-3151f94b8743 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:54.538010 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-43041547-2479-477a-95cb-1e9d704b7c39 req-ef1a7e55-ee4d-49f0-80af-3151f94b8743 service nova] Creating event network-vif-deleted:f43b1e9e-3571-489a-8a6f-25c327d5fa89 for instance a2af0949-b2f6-49e1-add2-7d85b03ea3ee on hv-cinder-84684 Jun 28 03:31:54.543879 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-43041547-2479-477a-95cb-1e9d704b7c39 req-ef1a7e55-ee4d-49f0-80af-3151f94b8743 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031024 Jun 28 03:31:54.544811 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 537/1065] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 28 03:31:54.558899 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-4482c496-69db-49bc-87f5-e5579d8fcbd0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:54.566605 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-4482c496-69db-49bc-87f5-e5579d8fcbd0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1391 microversion: 2.1 time: 0.083557 Jun 28 03:31:54.567174 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 529/1066] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:54 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1391 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:55.584338 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d3e0021f-bdf1-41a3-8e04-0d4d6decbfed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:55.585082 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d3e0021f-bdf1-41a3-8e04-0d4d6decbfed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:55.591951 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d3e0021f-bdf1-41a3-8e04-0d4d6decbfed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:55.592504 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d3e0021f-bdf1-41a3-8e04-0d4d6decbfed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:55.593949 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d3e0021f-bdf1-41a3-8e04-0d4d6decbfed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:55.594490 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d3e0021f-bdf1-41a3-8e04-0d4d6decbfed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:55.629041 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d3e0021f-bdf1-41a3-8e04-0d4d6decbfed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:55.629484 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d3e0021f-bdf1-41a3-8e04-0d4d6decbfed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:55.629929 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-d3e0021f-bdf1-41a3-8e04-0d4d6decbfed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lazy-loading 'fault' on Instance uuid a2af0949-b2f6-49e1-add2-7d85b03ea3ee {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:31:55.632725 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:55.677182 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d3e0021f-bdf1-41a3-8e04-0d4d6decbfed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:31:55.685166 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d3e0021f-bdf1-41a3-8e04-0d4d6decbfed tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 200 len: 1231 microversion: 2.1 time: 0.105809 Jun 28 03:31:55.686066 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 538/1067] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:55 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:31:56.704996 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ea8d7261-7994-40a0-834c-5da8e21ad9ea tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:56.705616 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-ea8d7261-7994-40a0-834c-5da8e21ad9ea tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: a2af0949-b2f6-49e1-add2-7d85b03ea3ee] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:56.709870 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_api:SELECT=31 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:56.717082 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea8d7261-7994-40a0-834c-5da8e21ad9ea tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:56.717665 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea8d7261-7994-40a0-834c-5da8e21ad9ea tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:56.718759 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea8d7261-7994-40a0-834c-5da8e21ad9ea tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:56.719370 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-ea8d7261-7994-40a0-834c-5da8e21ad9ea tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:56.735476 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-ea8d7261-7994-40a0-834c-5da8e21ad9ea tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] HTTP exception thrown: Instance a2af0949-b2f6-49e1-add2-7d85b03ea3ee could not be found. Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ea8d7261-7994-40a0-834c-5da8e21ad9ea tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Request method failure captured: Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee HTTP/1.1 Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunR1ij-HscsMZORDg-GrmoWUBiLr0yD0AdUjWzAWnAq9SpyPmJsre7q2VCDZXHY9vvgjwXJUwS5EJiAe8z4TqqlhlsLLeyy1-qhSQiApdrJc9tFJPIZdDsOaRT43YxG6_6Qznrhw0O3NasO6aDRCKwhWV29P9rfZTOw1Pn8cgFfO3bA Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: cc2d6ae6d1f74852b9b51d970d19d0df Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-TestVolumeBootPattern-261448631 Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:31:56.737210 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:31:56.738921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cc2d6ae6d1f74852b9b51d970d19d0df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:31:56.738921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-TestVolumeBootPattern-261448631 Jun 28 03:31:56.738921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: cc2d6ae6d1f74852b9b51d970d19d0df Jun 28 03:31:56.738921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-TestVolumeBootPattern-261448631 Jun 28 03:31:56.738921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-TestVolumeBootPattern-261448631-project Jun 28 03:31:56.738921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:31:56.738921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:31:56.738921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 3480ec26f30343e58a5e7b5329cb2cce Jun 28 03:31:56.738921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-TestVolumeBootPattern-261448631-project Jun 28 03:31:56.738921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:31:56.738921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance a2af0949-b2f6-49e1-add2-7d85b03ea3ee could not be found. Jun 28 03:31:56.738921 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': 'a2af0949-b2f6-49e1-add2-7d85b03ea3ee'} Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2af0949-b2f6-49e1-add2-7d85b03ea3ee could not be found. Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:31:56.739848 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2af0949-b2f6-49e1-add2-7d85b03ea3ee could not be found. Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2af0949-b2f6-49e1-add2-7d85b03ea3ee could not be found. Jun 28 03:31:56.741190 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:31:56.742355 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-ea8d7261-7994-40a0-834c-5da8e21ad9ea tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Returning 404 to user: Instance a2af0949-b2f6-49e1-add2-7d85b03ea3ee could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:31:56.742355 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-ea8d7261-7994-40a0-834c-5da8e21ad9ea tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee" status: 404 len: 111 microversion: 2.1 time: 0.038604 Jun 28 03:31:56.742355 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 530/1068] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:56 2022] GET /compute/v2.1/servers/a2af0949-b2f6-49e1-add2-7d85b03ea3ee => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:31:59.864805 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c39b8ec3-14c6-48cc-b09a-561531fd9f54 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:31:59.865326 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c39b8ec3-14c6-48cc-b09a-561531fd9f54 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:31:59.870207 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-d17a0cc9-3272-4b52-86b8-2b5fd9e58558 req-67994c77-8dcb-491d-afce-e96964cd3d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3d15481-1950-4451-a558-876c37530561", "tag": "3e2db863-652b-415d-8de9-73dd5344769a"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:31:59.873320 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:31:59.878570 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c39b8ec3-14c6-48cc-b09a-561531fd9f54 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:59.879098 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c39b8ec3-14c6-48cc-b09a-561531fd9f54 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:59.879543 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-d17a0cc9-3272-4b52-86b8-2b5fd9e58558 req-67994c77-8dcb-491d-afce-e96964cd3d55 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:59.880264 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-d17a0cc9-3272-4b52-86b8-2b5fd9e58558 req-67994c77-8dcb-491d-afce-e96964cd3d55 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:59.880389 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c39b8ec3-14c6-48cc-b09a-561531fd9f54 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:31:59.880751 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c39b8ec3-14c6-48cc-b09a-561531fd9f54 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:31:59.892743 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-d17a0cc9-3272-4b52-86b8-2b5fd9e58558 req-67994c77-8dcb-491d-afce-e96964cd3d55 service nova] Creating event network-changed:3e2db863-652b-415d-8de9-73dd5344769a for instance b3d15481-1950-4451-a558-876c37530561 on hv-cinder-84684 Jun 28 03:31:59.897963 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-d17a0cc9-3272-4b52-86b8-2b5fd9e58558 req-67994c77-8dcb-491d-afce-e96964cd3d55 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031334 Jun 28 03:31:59.899199 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 531/1069] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:31:59.911965 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c39b8ec3-14c6-48cc-b09a-561531fd9f54 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:31:59.994649 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c39b8ec3-14c6-48cc-b09a-561531fd9f54 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 204 len: 0 microversion: 2.1 time: 0.133599 Jun 28 03:31:59.995242 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 539/1070] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:31:59 2022] DELETE /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:32:00.004203 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-7dc45197-7c99-4aad-9708-e48378b2943a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:00.004925 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-7dc45197-7c99-4aad-9708-e48378b2943a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:00.011965 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7dc45197-7c99-4aad-9708-e48378b2943a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:00.012438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7dc45197-7c99-4aad-9708-e48378b2943a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:00.013474 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7dc45197-7c99-4aad-9708-e48378b2943a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:00.014900 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-7dc45197-7c99-4aad-9708-e48378b2943a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:00.150789 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-7dc45197-7c99-4aad-9708-e48378b2943a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:32:00.158983 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-7dc45197-7c99-4aad-9708-e48378b2943a tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1576 microversion: 2.1 time: 0.158985 Jun 28 03:32:00.159521 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 532/1071] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:31:59 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:32:01.180777 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-59731c36-7e53-4b3f-ad20-48248fb33767 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:01.181490 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-59731c36-7e53-4b3f-ad20-48248fb33767 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:01.191492 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-59731c36-7e53-4b3f-ad20-48248fb33767 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:01.192173 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-59731c36-7e53-4b3f-ad20-48248fb33767 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:01.193306 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-59731c36-7e53-4b3f-ad20-48248fb33767 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:01.193912 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-59731c36-7e53-4b3f-ad20-48248fb33767 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:01.339866 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-59731c36-7e53-4b3f-ad20-48248fb33767 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:32:01.348173 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-59731c36-7e53-4b3f-ad20-48248fb33767 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1576 microversion: 2.1 time: 0.173969 Jun 28 03:32:01.348765 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 540/1072] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:32:01 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:32:02.366048 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a4813d38-5762-4ac2-8c33-19ddf5ab3067 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:02.366645 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a4813d38-5762-4ac2-8c33-19ddf5ab3067 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:02.373521 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a4813d38-5762-4ac2-8c33-19ddf5ab3067 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:02.373960 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a4813d38-5762-4ac2-8c33-19ddf5ab3067 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:02.374712 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a4813d38-5762-4ac2-8c33-19ddf5ab3067 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:02.375138 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a4813d38-5762-4ac2-8c33-19ddf5ab3067 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:02.512493 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-a4813d38-5762-4ac2-8c33-19ddf5ab3067 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:32:02.521333 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a4813d38-5762-4ac2-8c33-19ddf5ab3067 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1576 microversion: 2.1 time: 0.159713 Jun 28 03:32:02.521894 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 533/1073] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:32:02 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:32:03.540307 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d9549a58-10c8-4fbb-84c1-a702c9e9464c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:03.540932 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d9549a58-10c8-4fbb-84c1-a702c9e9464c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:03.547816 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d9549a58-10c8-4fbb-84c1-a702c9e9464c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:03.548474 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d9549a58-10c8-4fbb-84c1-a702c9e9464c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:03.549376 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d9549a58-10c8-4fbb-84c1-a702c9e9464c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:03.549919 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d9549a58-10c8-4fbb-84c1-a702c9e9464c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:03.690527 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d9549a58-10c8-4fbb-84c1-a702c9e9464c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:32:03.698906 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d9549a58-10c8-4fbb-84c1-a702c9e9464c tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1576 microversion: 2.1 time: 0.163872 Jun 28 03:32:03.699474 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 541/1074] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:32:03 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:32:04.717027 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-57ea8483-a56f-4dab-8035-8ae49d5f0e26 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:04.717625 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-57ea8483-a56f-4dab-8035-8ae49d5f0e26 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:04.724517 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-57ea8483-a56f-4dab-8035-8ae49d5f0e26 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:04.724970 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-57ea8483-a56f-4dab-8035-8ae49d5f0e26 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:04.726035 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-57ea8483-a56f-4dab-8035-8ae49d5f0e26 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:04.726447 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-57ea8483-a56f-4dab-8035-8ae49d5f0e26 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:04.867463 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-57ea8483-a56f-4dab-8035-8ae49d5f0e26 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:32:04.875480 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-57ea8483-a56f-4dab-8035-8ae49d5f0e26 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1576 microversion: 2.1 time: 0.162403 Jun 28 03:32:04.876052 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 534/1075] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:32:04 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:32:05.900908 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-90cb8fac-a18f-4f30-88b8-92fd7516fae5 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:05.901468 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-90cb8fac-a18f-4f30-88b8-92fd7516fae5 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:05.911791 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-90cb8fac-a18f-4f30-88b8-92fd7516fae5 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:05.912559 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-90cb8fac-a18f-4f30-88b8-92fd7516fae5 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:05.913713 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-90cb8fac-a18f-4f30-88b8-92fd7516fae5 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:05.914359 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-90cb8fac-a18f-4f30-88b8-92fd7516fae5 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:06.060100 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-90cb8fac-a18f-4f30-88b8-92fd7516fae5 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:32:06.071988 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-90cb8fac-a18f-4f30-88b8-92fd7516fae5 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1576 microversion: 2.1 time: 0.176155 Jun 28 03:32:06.072817 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 542/1076] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:32:05 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:32:07.094253 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-6f5eae33-d305-4467-905c-06560d582c12 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:07.094868 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-6f5eae33-d305-4467-905c-06560d582c12 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:07.102153 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6f5eae33-d305-4467-905c-06560d582c12 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:07.102863 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6f5eae33-d305-4467-905c-06560d582c12 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:07.103683 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6f5eae33-d305-4467-905c-06560d582c12 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:07.104110 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-6f5eae33-d305-4467-905c-06560d582c12 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:07.239963 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-6f5eae33-d305-4467-905c-06560d582c12 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:32:07.251577 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-6f5eae33-d305-4467-905c-06560d582c12 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1576 microversion: 2.1 time: 0.161523 Jun 28 03:32:07.252128 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 535/1077] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:32:07 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:32:07.684520 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-1932137f-8fc5-4ab5-a392-e8fe9f7237c9 req-6d41ead9-fef9-4271-8457-dc784a90ac47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d15481-1950-4451-a558-876c37530561", "name": "network-vif-deleted", "tag": "3e2db863-652b-415d-8de9-73dd5344769a"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:32:07.693386 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-1932137f-8fc5-4ab5-a392-e8fe9f7237c9 req-6d41ead9-fef9-4271-8457-dc784a90ac47 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:07.693835 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-1932137f-8fc5-4ab5-a392-e8fe9f7237c9 req-6d41ead9-fef9-4271-8457-dc784a90ac47 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:07.705013 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-1932137f-8fc5-4ab5-a392-e8fe9f7237c9 req-6d41ead9-fef9-4271-8457-dc784a90ac47 service nova] Creating event network-vif-deleted:3e2db863-652b-415d-8de9-73dd5344769a for instance b3d15481-1950-4451-a558-876c37530561 on hv-cinder-84684 Jun 28 03:32:07.710055 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-1932137f-8fc5-4ab5-a392-e8fe9f7237c9 req-6d41ead9-fef9-4271-8457-dc784a90ac47 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029213 Jun 28 03:32:07.710654 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 543/1078] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:32:08.269225 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-929e74a1-9143-44a8-9d73-f44f920eeee0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:08.269808 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-929e74a1-9143-44a8-9d73-f44f920eeee0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:08.276985 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-929e74a1-9143-44a8-9d73-f44f920eeee0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:08.277438 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-929e74a1-9143-44a8-9d73-f44f920eeee0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:08.278215 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-929e74a1-9143-44a8-9d73-f44f920eeee0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:08.278633 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-929e74a1-9143-44a8-9d73-f44f920eeee0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:08.311001 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-929e74a1-9143-44a8-9d73-f44f920eeee0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:08.311442 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-929e74a1-9143-44a8-9d73-f44f920eeee0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:08.311885 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.objects.instance [None req-929e74a1-9143-44a8-9d73-f44f920eeee0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lazy-loading 'fault' on Instance uuid b3d15481-1950-4451-a558-876c37530561 {{(pid=117681) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:32:08.358898 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.policy [None req-929e74a1-9143-44a8-9d73-f44f920eeee0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3480ec26f30343e58a5e7b5329cb2cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2d6ae6d1f74852b9b51d970d19d0df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117681) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:32:08.366954 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-929e74a1-9143-44a8-9d73-f44f920eeee0 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 200 len: 1229 microversion: 2.1 time: 0.101805 Jun 28 03:32:08.367523 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 536/1079] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:32:08 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:32:09.386408 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-600395e8-b732-49a0-a706-343b4bd4f1f1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:09.387123 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-600395e8-b732-49a0-a706-343b4bd4f1f1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: b3d15481-1950-4451-a558-876c37530561] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:09.393593 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-600395e8-b732-49a0-a706-343b4bd4f1f1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:09.394038 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-600395e8-b732-49a0-a706-343b4bd4f1f1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:09.394787 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-600395e8-b732-49a0-a706-343b4bd4f1f1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:09.395219 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-600395e8-b732-49a0-a706-343b4bd4f1f1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:09.409144 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-600395e8-b732-49a0-a706-343b4bd4f1f1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] HTTP exception thrown: Instance b3d15481-1950-4451-a558-876c37530561 could not be found. Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-600395e8-b732-49a0-a706-343b4bd4f1f1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Request method failure captured: Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 HTTP/1.1 Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Connection: close Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Host: 10.222.0.44 Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABiunR1ij-HscsMZORDg-GrmoWUBiLr0yD0AdUjWzAWnAq9SpyPmJsre7q2VCDZXHY9vvgjwXJUwS5EJiAe8z4TqqlhlsLLeyy1-qhSQiApdrJc9tFJPIZdDsOaRT43YxG6_6Qznrhw0O3NasO6aDRCKwhWV29P9rfZTOw1Pn8cgFfO3bA Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Id: cc2d6ae6d1f74852b9b51d970d19d0df Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-TestVolumeBootPattern-261448631 Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 28 03:32:09.410744 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 28 03:32:09.412458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cc2d6ae6d1f74852b9b51d970d19d0df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:32:09.412458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-TestVolumeBootPattern-261448631 Jun 28 03:32:09.412458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Id: cc2d6ae6d1f74852b9b51d970d19d0df Jun 28 03:32:09.412458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-TestVolumeBootPattern-261448631 Jun 28 03:32:09.412458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User: tempest-TestVolumeBootPattern-261448631-project Jun 28 03:32:09.412458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 28 03:32:09.412458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 28 03:32:09.412458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Id: 3480ec26f30343e58a5e7b5329cb2cce Jun 28 03:32:09.412458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-TestVolumeBootPattern-261448631-project Jun 28 03:32:09.412458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: method: > Jun 28 03:32:09.412458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: exception: Instance b3d15481-1950-4451-a558-876c37530561 could not be found. Jun 28 03:32:09.412458 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: action_args: {'id': 'b3d15481-1950-4451-a558-876c37530561'} Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3d15481-1950-4451-a558-876c37530561 could not be found. Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:32:09.413427 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3d15481-1950-4451-a558-876c37530561 could not be found. Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3d15481-1950-4451-a558-876c37530561 could not be found. Jun 28 03:32:09.415029 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 28 03:32:09.416514 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-600395e8-b732-49a0-a706-343b4bd4f1f1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Returning 404 to user: Instance b3d15481-1950-4451-a558-876c37530561 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:32:09.416514 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-600395e8-b732-49a0-a706-343b4bd4f1f1 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561" status: 404 len: 111 microversion: 2.1 time: 0.030586 Jun 28 03:32:09.416514 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 544/1080] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:32:09 2022] GET /compute/v2.1/servers/b3d15481-1950-4451-a558-876c37530561 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:32:10.150664 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-43feeee3-9a8f-4be3-9758-57ce3c02cd77 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:10.151225 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-43feeee3-9a8f-4be3-9758-57ce3c02cd77 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:10.155668 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4fd934ee-77c0-43ba-bbac-f2b0f9eb9b50 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:10.156242 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4fd934ee-77c0-43ba-bbac-f2b0f9eb9b50 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:10.157824 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-43feeee3-9a8f-4be3-9758-57ce3c02cd77 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:10.158264 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-43feeee3-9a8f-4be3-9758-57ce3c02cd77 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:10.159008 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-43feeee3-9a8f-4be3-9758-57ce3c02cd77 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:10.159461 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-43feeee3-9a8f-4be3-9758-57ce3c02cd77 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:10.162908 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4fd934ee-77c0-43ba-bbac-f2b0f9eb9b50 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:10.163484 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4fd934ee-77c0-43ba-bbac-f2b0f9eb9b50 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:10.164279 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4fd934ee-77c0-43ba-bbac-f2b0f9eb9b50 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:10.164718 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4fd934ee-77c0-43ba-bbac-f2b0f9eb9b50 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:10.172922 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-43feeee3-9a8f-4be3-9758-57ce3c02cd77 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] HTTP exception thrown: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-43feeee3-9a8f-4be3-9758-57ce3c02cd77 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Request method failure captured: Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: DELETE /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 HTTP/1.1 Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunR1ij-HscsMZORDg-GrmoWUBiLr0yD0AdUjWzAWnAq9SpyPmJsre7q2VCDZXHY9vvgjwXJUwS5EJiAe8z4TqqlhlsLLeyy1-qhSQiApdrJc9tFJPIZdDsOaRT43YxG6_6Qznrhw0O3NasO6aDRCKwhWV29P9rfZTOw1Pn8cgFfO3bA Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: cc2d6ae6d1f74852b9b51d970d19d0df Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-TestVolumeBootPattern-261448631 Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:32:10.174693 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:32:10.176119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cc2d6ae6d1f74852b9b51d970d19d0df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:32:10.176119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-TestVolumeBootPattern-261448631 Jun 28 03:32:10.176119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: cc2d6ae6d1f74852b9b51d970d19d0df Jun 28 03:32:10.176119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-TestVolumeBootPattern-261448631 Jun 28 03:32:10.176119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-TestVolumeBootPattern-261448631-project Jun 28 03:32:10.176119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:32:10.176119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:32:10.176119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 3480ec26f30343e58a5e7b5329cb2cce Jun 28 03:32:10.176119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-TestVolumeBootPattern-261448631-project Jun 28 03:32:10.176119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:32:10.176119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:32:10.176119 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '10e32105-0f00-4bec-be78-59f9383e3992'} Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:32:10.176935 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:32:10.178214 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:10.179564 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-43feeee3-9a8f-4be3-9758-57ce3c02cd77 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Returning 404 to user: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:32:10.179564 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-43feeee3-9a8f-4be3-9758-57ce3c02cd77 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "DELETE /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 404 len: 111 microversion: 2.1 time: 0.029460 Jun 28 03:32:10.179564 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 537/1081] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:32:10 2022] DELETE /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 03:32:10.184458 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f3391a66-4917-489a-9e6f-ba4e60c505ce tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:10.185054 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-f3391a66-4917-489a-9e6f-ba4e60c505ce tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] [instance: 10e32105-0f00-4bec-be78-59f9383e3992] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:10.190930 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f3391a66-4917-489a-9e6f-ba4e60c505ce tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:10.191367 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f3391a66-4917-489a-9e6f-ba4e60c505ce tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:10.192108 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f3391a66-4917-489a-9e6f-ba4e60c505ce tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:10.192563 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-f3391a66-4917-489a-9e6f-ba4e60c505ce tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:10.207787 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-f3391a66-4917-489a-9e6f-ba4e60c505ce tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] HTTP exception thrown: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f3391a66-4917-489a-9e6f-ba4e60c505ce tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Request method failure captured: Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 HTTP/1.1 Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunR1ij-HscsMZORDg-GrmoWUBiLr0yD0AdUjWzAWnAq9SpyPmJsre7q2VCDZXHY9vvgjwXJUwS5EJiAe8z4TqqlhlsLLeyy1-qhSQiApdrJc9tFJPIZdDsOaRT43YxG6_6Qznrhw0O3NasO6aDRCKwhWV29P9rfZTOw1Pn8cgFfO3bA Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: cc2d6ae6d1f74852b9b51d970d19d0df Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-TestVolumeBootPattern-261448631 Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:32:10.209091 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:32:10.210732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cc2d6ae6d1f74852b9b51d970d19d0df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cc2d6ae6d1f74852b9b51d970d19d0df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:32:10.210732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-TestVolumeBootPattern-261448631 Jun 28 03:32:10.210732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: cc2d6ae6d1f74852b9b51d970d19d0df Jun 28 03:32:10.210732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-TestVolumeBootPattern-261448631 Jun 28 03:32:10.210732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-TestVolumeBootPattern-261448631-project Jun 28 03:32:10.210732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:32:10.210732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:32:10.210732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 3480ec26f30343e58a5e7b5329cb2cce Jun 28 03:32:10.210732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-TestVolumeBootPattern-261448631-project Jun 28 03:32:10.210732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:32:10.210732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:32:10.210732 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '10e32105-0f00-4bec-be78-59f9383e3992'} Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:32:10.211914 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. Jun 28 03:32:10.213454 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:10.215272 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-f3391a66-4917-489a-9e6f-ba4e60c505ce tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Returning 404 to user: Instance 10e32105-0f00-4bec-be78-59f9383e3992 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:32:10.215272 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-f3391a66-4917-489a-9e6f-ba4e60c505ce tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992" status: 404 len: 111 microversion: 2.1 time: 0.029704 Jun 28 03:32:10.215272 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 538/1082] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:32:10 2022] GET /compute/v2.1/servers/10e32105-0f00-4bec-be78-59f9383e3992 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 28 03:32:10.247761 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-4fd934ee-77c0-43ba-bbac-f2b0f9eb9b50 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lazy-loading 'services' on Instance uuid 0fe2c31b-d667-452d-afc4-ab061d459781 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:32:10.327352 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4fd934ee-77c0-43ba-bbac-f2b0f9eb9b50 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781/os-volume_attachments/aae080ea-f2d1-43db-a970-003527f58efb" status: 202 len: 0 microversion: 2.1 time: 0.175627 Jun 28 03:32:10.327955 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 545/1083] 10.222.0.44 () {58 vars in 1415 bytes} [Tue Jun 28 03:32:10 2022] DELETE /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781/os-volume_attachments/aae080ea-f2d1-43db-a970-003527f58efb => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 28 03:32:11.451917 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-91d9d206-5f85-4f6f-96ec-aef13678af6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:11.452481 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-91d9d206-5f85-4f6f-96ec-aef13678af6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:11.459281 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-91d9d206-5f85-4f6f-96ec-aef13678af6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:11.459717 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-91d9d206-5f85-4f6f-96ec-aef13678af6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:11.460506 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-91d9d206-5f85-4f6f-96ec-aef13678af6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:11.460932 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-91d9d206-5f85-4f6f-96ec-aef13678af6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:11.487143 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-91d9d206-5f85-4f6f-96ec-aef13678af6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Going to try to terminate instance {{(pid=117681) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 28 03:32:11.489991 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG dbcounter [-] [117681] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117681) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 28 03:32:11.570637 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-91d9d206-5f85-4f6f-96ec-aef13678af6b tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 204 len: 0 microversion: 2.1 time: 0.122263 Jun 28 03:32:11.571429 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 539/1084] 10.222.0.44 () {58 vars in 1238 bytes} [Tue Jun 28 03:32:11 2022] DELETE /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 28 03:32:11.580727 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d8eca142-ac3b-476a-8b62-c0b9b231410f tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:11.581409 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d8eca142-ac3b-476a-8b62-c0b9b231410f tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:11.587632 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d8eca142-ac3b-476a-8b62-c0b9b231410f tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:11.588100 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d8eca142-ac3b-476a-8b62-c0b9b231410f tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:11.588936 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d8eca142-ac3b-476a-8b62-c0b9b231410f tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:11.589358 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d8eca142-ac3b-476a-8b62-c0b9b231410f tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:11.759041 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d8eca142-ac3b-476a-8b62-c0b9b231410f tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:32:11.766922 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d8eca142-ac3b-476a-8b62-c0b9b231410f tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1514 microversion: 2.1 time: 0.191196 Jun 28 03:32:11.776477 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 546/1085] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:32:11 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:32:11.794325 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-af5a850f-2878-4c5a-858c-b64578b23081 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] Calling method '.version_select at 0x7f53f1f12550>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:11.817478 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-af5a850f-2878-4c5a-858c-b64578b23081 tempest-TestVolumeBootPattern-261448631 tempest-TestVolumeBootPattern-261448631-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1536016975" status: 202 len: 0 microversion: 2.1 time: 0.027395 Jun 28 03:32:11.818197 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 540/1086] 10.222.0.44 () {58 vars in 1262 bytes} [Tue Jun 28 03:32:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1536016975 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 28 03:32:12.784072 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0396eefd-fb69-485e-aa0f-ca8da45f8ce0 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:12.785292 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0396eefd-fb69-485e-aa0f-ca8da45f8ce0 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:12.793887 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0396eefd-fb69-485e-aa0f-ca8da45f8ce0 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:12.794616 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0396eefd-fb69-485e-aa0f-ca8da45f8ce0 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:12.795602 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0396eefd-fb69-485e-aa0f-ca8da45f8ce0 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:12.796289 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0396eefd-fb69-485e-aa0f-ca8da45f8ce0 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:13.024532 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0396eefd-fb69-485e-aa0f-ca8da45f8ce0 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:32:13.033901 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0396eefd-fb69-485e-aa0f-ca8da45f8ce0 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1514 microversion: 2.1 time: 0.253610 Jun 28 03:32:13.034527 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 547/1087] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:32:12 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:32:13.773071 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [req-eaac059e-edb1-41dc-a26a-99d2acb16ba0 req-124a333d-8f5b-4baf-b110-04f8775fd250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fe2c31b-d667-452d-afc4-ab061d459781", "name": "network-vif-deleted", "tag": "40fa138e-e74f-4334-951f-6f55161d50e3"}]} {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 28 03:32:13.783706 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-eaac059e-edb1-41dc-a26a-99d2acb16ba0 req-124a333d-8f5b-4baf-b110-04f8775fd250 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:13.784547 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [req-eaac059e-edb1-41dc-a26a-99d2acb16ba0 req-124a333d-8f5b-4baf-b110-04f8775fd250 service nova] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:13.796977 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.compute.server_external_events [req-eaac059e-edb1-41dc-a26a-99d2acb16ba0 req-124a333d-8f5b-4baf-b110-04f8775fd250 service nova] Creating event network-vif-deleted:40fa138e-e74f-4334-951f-6f55161d50e3 for instance 0fe2c31b-d667-452d-afc4-ab061d459781 on hv-cinder-84684 Jun 28 03:32:13.803327 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [req-eaac059e-edb1-41dc-a26a-99d2acb16ba0 req-124a333d-8f5b-4baf-b110-04f8775fd250 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034569 Jun 28 03:32:13.804954 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 541/1088] 10.222.0.44 () {64 vars in 1317 bytes} [Tue Jun 28 03:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 28 03:32:14.051470 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b83f14b0-2c0e-4547-83d2-980a9d95f93e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:14.052200 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b83f14b0-2c0e-4547-83d2-980a9d95f93e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:14.059072 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b83f14b0-2c0e-4547-83d2-980a9d95f93e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:14.059525 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b83f14b0-2c0e-4547-83d2-980a9d95f93e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:14.060281 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b83f14b0-2c0e-4547-83d2-980a9d95f93e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:14.060722 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b83f14b0-2c0e-4547-83d2-980a9d95f93e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:14.092338 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b83f14b0-2c0e-4547-83d2-980a9d95f93e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:14.092775 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b83f14b0-2c0e-4547-83d2-980a9d95f93e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:14.093217 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-b83f14b0-2c0e-4547-83d2-980a9d95f93e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lazy-loading 'fault' on Instance uuid 0fe2c31b-d667-452d-afc4-ab061d459781 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 28 03:32:14.151662 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b83f14b0-2c0e-4547-83d2-980a9d95f93e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fb857949a344cc99dd6a2f9a5e64152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b8b4e2041e41dc8716272d68867537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 28 03:32:14.159449 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b83f14b0-2c0e-4547-83d2-980a9d95f93e tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 200 len: 1309 microversion: 2.1 time: 0.112087 Jun 28 03:32:14.160010 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 548/1089] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:32:14 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 28 03:32:15.178011 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a259d46d-c103-4e03-b621-a47828f8f921 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Calling method '>' {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 28 03:32:15.178831 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.compute.api [None req-a259d46d-c103-4e03-b621-a47828f8f921 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] [instance: 0fe2c31b-d667-452d-afc4-ab061d459781] Fetching instance by UUID {{(pid=117681) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 28 03:32:15.185916 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a259d46d-c103-4e03-b621-a47828f8f921 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:15.186368 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a259d46d-c103-4e03-b621-a47828f8f921 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:15.187147 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a259d46d-c103-4e03-b621-a47828f8f921 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 28 03:32:15.187583 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG oslo_concurrency.lockutils [None req-a259d46d-c103-4e03-b621-a47828f8f921 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Lock "e98e3abb-bf26-4fd3-abd9-1f639c67dc6f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117681) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 28 03:32:15.201461 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.wsgi [None req-a259d46d-c103-4e03-b621-a47828f8f921 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] HTTP exception thrown: Instance 0fe2c31b-d667-452d-afc4-ab061d459781 could not be found. Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a259d46d-c103-4e03-b621-a47828f8f921 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Request method failure captured: Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: request: GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 HTTP/1.1 Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept: application/json Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Accept-Encoding: identity Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Connection: close Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Length: 0 Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Content-Type: application/json Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Host: 10.222.0.44 Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Openstack-System-Scope: None Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: User-Agent: python-urllib3/1.26.9 Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Auth-Token: gAAAAABiunXb5JymarbS0kFflAhajWNne7PfDRLPha-5AmvfY7eruNHrG21e_nnK7Ur54eSqiEVcq5kEgRPCFSfL07YP4CmqEJzJ_UXmC_s_1TFRnqCMKdBRMZ3tgRiIwSctsZV6XEWiz0PBG6qn_ap1JZi4nHLhkuNm-7RhLd1V6YKDhI9ygfg Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Id: None Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Domain-Name: None Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Identity-Status: Confirmed Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Is-Admin-Project: True Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Id: default Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Domain-Name: Default Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Id: 10b8b4e2041e41dc8716272d68867537 Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1032863486 Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Role: member,reader Jun 28 03:32:15.203097 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Roles: member,reader Jun 28 03:32:15.204610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_10b8b4e2041e41dc8716272d68867537", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/10b8b4e2041e41dc8716272d68867537"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/10b8b4e2041e41dc8716272d68867537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/10b8b4e2041e41dc8716272d68867537"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}] Jun 28 03:32:15.204610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant: tempest-VolumesSnapshotTestJSON-1032863486 Jun 28 03:32:15.204610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Id: 10b8b4e2041e41dc8716272d68867537 Jun 28 03:32:15.204610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1032863486 Jun 28 03:32:15.204610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User: tempest-VolumesSnapshotTestJSON-1032863486-project Jun 28 03:32:15.204610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Id: default Jun 28 03:32:15.204610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Domain-Name: Default Jun 28 03:32:15.204610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Id: 4fb857949a344cc99dd6a2f9a5e64152 Jun 28 03:32:15.204610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: X-User-Name: tempest-VolumesSnapshotTestJSON-1032863486-project Jun 28 03:32:15.204610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: method: > Jun 28 03:32:15.204610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: exception: Instance 0fe2c31b-d667-452d-afc4-ab061d459781 could not be found. Jun 28 03:32:15.204610 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: action_args: {'id': '0fe2c31b-d667-452d-afc4-ab061d459781'} Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: {{(pid=117681) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fe2c31b-d667-452d-afc4-ab061d459781 could not be found. Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 28 03:32:15.205410 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fe2c31b-d667-452d-afc4-ab061d459781 could not be found. Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fe2c31b-d667-452d-afc4-ab061d459781 could not be found. Jun 28 03:32:15.206647 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: ERROR nova.api.openstack.wsgi Jun 28 03:32:15.207777 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: DEBUG nova.api.openstack.wsgi [None req-a259d46d-c103-4e03-b621-a47828f8f921 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] Returning 404 to user: Instance 0fe2c31b-d667-452d-afc4-ab061d459781 could not be found. {{(pid=117681) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 28 03:32:15.207777 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO nova.api.openstack.requestlog [None req-a259d46d-c103-4e03-b621-a47828f8f921 tempest-VolumesSnapshotTestJSON-1032863486 tempest-VolumesSnapshotTestJSON-1032863486-project] 10.222.0.44 "GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781" status: 404 len: 111 microversion: 2.1 time: 0.031228 Jun 28 03:32:15.207777 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: [pid: 117681|app: 0|req: 542/1090] 10.222.0.44 () {58 vars in 1235 bytes} [Tue Jun 28 03:32:15 2022] GET /compute/v2.1/servers/0fe2c31b-d667-452d-afc4-ab061d459781 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 28 03:33:02.317960 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 03:33:02.319250 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Tue Jun 28 03:33:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 03:33:03.141814 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 03:33:03.142510 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Tue Jun 28 03:33:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 03:34:40.351010 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 03:34:40.352451 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Tue Jun 28 03:34:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 03:35:12.549185 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 03:35:12.550493 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Tue Jun 28 03:35:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 03:36:22.331640 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 03:36:22.332811 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Tue Jun 28 03:36:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 03:36:23.153197 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 03:36:23.154094 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Tue Jun 28 03:36:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 03:37:51.849337 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 03:37:51.850338 dv-cinder-846842-5-iscsi devstack@n-api.service[117681]: Tue Jun 28 03:37:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 28 03:38:00.364561 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 28 03:38:00.364561 dv-cinder-846842-5-iscsi devstack@n-api.service[117680]: Tue Jun 28 03:38:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!